qMetry Vs. Xray Comparison in 2024

Deciding between Test Management Tools is a big challenge. There are several excellent free software Test Management Software tools, as well as paid test management solutions available. The three we will be comparing today are qMetry Vs. Xray, along with AccelaTest. While the three are all great options for creating test cases, test data, and executing tests, deciding which software tool is best for your QA team will come down to cost, your QA process, and the features your team demands.

Summary of Comparison

Before getting into the fine-level details of each of the software testing applications, we will analyze their core test management solution features.

What is each of the software testing tools going to cost?

Both qMetry and Xray require a subscription. In contrast,  the features in AccelaTest are, and always will be, completely free for teams.

The pricing for each test case management tool is as follows:

  • qMetry : Quote Required
  • Xray: Starts at $10 / year
  • AccelaTest: price is always $0.00 per user per month

Additionally, both of these solutions do offer a free trial. In the pricing arena, AccelaTest is the clear winner for being the only no-cost solution that supports your entire testing process, including automated testing.

How do the tools rank as a Test Case Management Solution?

Test Case Management tools should be great at managing test cases and the SDLC. Fortunately, all three contenders deliver on their ability to manage tests and offer the ability to clone tests. The most notable differences between the tools are a lack of Session-based exploratory testing for qMetry and AccelaTest and the inability to reuse test repositories for Xray. AccelaTest is still in active development and working towards adding the nice-to-have features. As the core features offered by all the tools in this arena are roughly the same, and the missing features may not be needed by all teams, we declare a tie.

How do the tools rank on the ability to Manage Test Runs?

The ability to run your test cases and report the results out is of equal importance. Fortunately, once again, all three contenders deliver on this both the ability to run tests and report results. The most notable differences are Xray’s inability to mark a test result in a single click. Once again, the AccelaTest team is hard at work adding enhancements to test automation. Once all of the automated testing enhancements are complete, AccelaTest will be the clear winner in this category.

39 points of qMetry Vs. Xray Comparison:

In this comparison of qMetry, Xray, and AccelaTest, we will be comparing these tool features: Requirement Management, Test Cases, Execution of Test Cycles, Bugs or Defects, Integration Capabilities, Certifications, Support, Reporting, and finally finish up with Pricing.

As with all software testing tools, there are pros and cons to each. So lets get into them.

Requirement Management

Hierarchical requirements support
Requirement and Defect Linking

Test Case Management

Add attachments to test steps
Duplicate tests between projects
Create, view, edit, clone tests within project
Reusable test repositories
Session-based exploratory testing
Gherkin/Cucumber (BDD) support
Summary / Pre-Conditions

Test Sets and Execution Management

Test execution and results audit history
Modify tests during test execution 1
Report defects from test runner 1
Assign tests to testers
Test Case Parameterization
Ability to Clone, Edit, and Delete Test Runs
Associate test repository to any test execution set
Set test result (pass/fail) status in one click.

Bug Management

Standalone issue management module
3rd party issue tracking integrations
Ability to report issues directly (email, Slack, Teams)

Integrations

Integration with Test Automation Tools
Jira Issues
Zapier
API
Slack integration
Webhooks

Customization

Filter information hierarchically (examples: Test names, Test tree, Bug details)
Custom workflows
Custom tags or fields
Permission-Based Privileges

Reporting

Customizable graphs, dashboards, and metrics
Scheduled report delivery

Additional Features

Import & Export all data
Search (ability to add criteria)
Installation on-premises or Cloud Cloud Both Both
Task Board

Security and Certifications

Soc 2
ISO 27001

Service and Support

Support

Pricing

Price
From $0/mo
Not Transparent
Quote Required
Starts at $10 / year
Start Subscription

Legend:
1: Functionality is on roadmap to be implemented.
2: Email support to activate for your project.

Conclusion

Hopefully, you now have a better understanding of Xray Vs. qMetry, in addition to our Test Management tool. Many of the tools offer similar features and will continue to add additional features, making the cost of the test management tool a significant differentiator. The test case management features of AccelaTest are forever free for teams. Open your free account now.

Resources: