Deciding between Test Management Tools is a big challenge. There are several excellent free software Test Management Software tools, as well as paid test management solutions available. The three we will be comparing today are qMetry Vs. Xray, along with AccelaTest. While the three are all great options for creating test cases, test data, and executing tests, deciding which software tool is best for your QA team will come down to cost, your QA process, and the features your team demands.
Summary of Comparison
Before getting into the fine-level details of each of the software testing applications, we will analyze their core test management solution features.
What is each of the software testing tools going to cost?
Both qMetry and Xray require a subscription. In contrast, the features in AccelaTest are, and always will be, completely free for teams.
The pricing for each test case management tool is as follows:
- qMetry : Quote Required
- Xray: Starts at $10 / year
- AccelaTest: price is always $0.00 per user per month
Additionally, both of these solutions do offer a free trial. In the pricing arena, AccelaTest is the clear winner for being the only no-cost solution that supports your entire testing process, including automated testing.
How do the tools rank as a Test Case Management Solution?
Test Case Management tools should be great at managing test cases and the SDLC. Fortunately, all three contenders deliver on their ability to manage tests and offer the ability to clone tests. The most notable differences between the tools are a lack of Session-based exploratory testing for qMetry and AccelaTest and the inability to reuse test repositories for Xray. AccelaTest is still in active development and working towards adding the nice-to-have features. As the core features offered by all the tools in this arena are roughly the same, and the missing features may not be needed by all teams, we declare a tie.
How do the tools rank on the ability to Manage Test Runs?
The ability to run your test cases and report the results out is of equal importance. Fortunately, once again, all three contenders deliver on this both the ability to run tests and report results. The most notable differences are Xray’s inability to mark a test result in a single click. Once again, the AccelaTest team is hard at work adding enhancements to test automation. Once all of the automated testing enhancements are complete, AccelaTest will be the clear winner in this category.
39 points of qMetry Vs. Xray Comparison:
In this comparison of qMetry, Xray, and AccelaTest, we will be comparing these tool features: Requirement Management, Test Cases, Execution of Test Cycles, Bugs or Defects, Integration Capabilities, Certifications, Support, Reporting, and finally finish up with Pricing.
As with all software testing tools, there are pros and cons to each. So lets get into them.
 |
 |
 |
||||
|---|---|---|---|---|---|---|
Requirement Management |
||||||
| Hierarchical requirements support | ||||||
| Requirement and Defect Linking | ||||||
Test Case Management |
||||||
| Add attachments to test steps | ||||||
| Duplicate tests between projects | ||||||
| Create, view, edit, clone tests within project | ||||||
| Reusable test repositories | ||||||
| Session-based exploratory testing | ||||||
| Gherkin/Cucumber (BDD) support | ||||||
| Summary / Pre-Conditions | ||||||
Test Sets and Execution Management |
||||||
| Test execution and results audit history | ||||||
| Modify tests during test execution | 1 | |||||
| Report defects from test runner | 1 | |||||
| Assign tests to testers | ||||||
| Test Case Parameterization | ||||||
| Ability to Clone, Edit, and Delete Test Runs | ||||||
| Associate test repository to any test execution set | ||||||
| Set test result (pass/fail) status in one click. | ||||||
Bug Management |
||||||
| Standalone issue management module | ||||||
| 3rd party issue tracking integrations | ||||||
| Ability to report issues directly (email, Slack, Teams) | ||||||
Integrations |
||||||
| Integration with Test Automation Tools | ||||||
| Jira Issues | ||||||
| Zapier | ||||||
| API | ||||||
| Slack integration | ||||||
| Webhooks | ||||||
Customization |
||||||
| Filter information hierarchically (examples: Test names, Test tree, Bug details) | ||||||
| Custom workflows | ||||||
| Custom tags or fields | ||||||
| Permission-Based Privileges | ||||||
Reporting |
||||||
| Customizable graphs, dashboards, and metrics | ||||||
| Scheduled report delivery | ||||||
Additional Features |
||||||
| Import & Export all data | ||||||
| Search (ability to add criteria) | ||||||
| Installation on-premises or Cloud | Cloud | Both | Both | |||
| Task Board | ||||||
Security and Certifications |
||||||
| Soc 2 | ||||||
| ISO 27001 | ||||||
Service and Support |
||||||
| Support | ||||||
Pricing |
||||||
| Price |
|
Not Transparent Quote Required |
Starts at $10 / year Start Subscription |
|||
Legend:
1: Functionality is on roadmap to be implemented.
2: Email support to activate for your project.
Conclusion
Hopefully, you now have a better understanding of Xray Vs. qMetry, in addition to our Test Management tool. Many of the tools offer similar features and will continue to add additional features, making the cost of the test management tool a significant differentiator. The test case management features of AccelaTest are forever free for teams. Open your free account now.
Resources: