Revenue Protection and Change Stability Value Driver
Perhaps one of the most important QA metrics to track is how much revenue is being protected by QA efforts as a whole. This is most impactful in terms of ROI to the business, outside of time savings.
Defect Escape Rate
Another key DORA metric we track in Quality Hub is the escape ratio of defects (or bugs). Most organizations use tools such as JIRA, Azure DevOps (ADO), or other dedicated Test Management & Defect Tracking tools to log and track work on bugs. Our goal is to allow our users to surface that data in direct relation to the overall testing effort, rather than create another system of record for you to maintain.
With that in mind, our JIRA/ADO integration allows us to import and bi-directionally sync issues and defects so that users can continue to use familiar tooling and only come to Provar Quality Hub for reporting, analytics, collaboration, and integrations. For more information, see Defect Management.
This metric tracks the # of production incidents as a percentage of overall defects raised for the given time period. The metric card displays the current average defect escape rate.
If you click into the metric drilldown for Defect Escape Rate, you’ll get a detailed breakdown of your current escape rate, the average escape rate, total # defects, total production defects, and number escaped this month. This gives you relevant, timely, actionable data to take to your QA teams to focus efforts and show improvements over time.
The insights here are also data-driven and reportable. The example insights above tell us that 88% of our total defects were caught before production, and our current escape rate is a measurable improvement over the current average, showcasing improved testing coverage!
As with other metric drilldowns, you’ll also see the steps to improve your defect escape rate, the current maturity tier, and the KPI thresholds for your organization.
On the whole, defect escape rate is one of the true markers of a high-quality product, and tracking against this metric can convey the value of QA to the entire organization.