Test Executions and Defect Management

Defect Management

Defects can be raised on Test Execution or Test Step Execution records, depending on the preferred level of granularity. They are linked to Test Case or Test Step records for traceability and reporting purposes, and you can define their impact and priority, as well as track their status.

Test Cycle Closure

This phase involves several activities like test completion reporting, collection of test completion matrices and test results. Testing team members meet, discuss and analyze testing artefacts to identify strategies that have to be implemented in future, taking lessons from the current test cycle. The idea is to remove process bottlenecks for future test cycles.

Actionable Insights

Provar Manager provides an initial set of reports and dashboards to help your team gather insights from your testing activities.

Because all the information is stored in Salesforce, your team can further leverage the Salesforce platform to create standard reports and dashboards or use BI and analytics tools like Tableau or CRM Analytics to produce more profound insights.

Dashboards

Test Cases Dashboard

Above: Snapshot of the Test Cases dashboard.

The Test Cases dashboard shows information about your test cases, risks, and test owners.

• Test Cases by Type is useful to understand how your test cases are distributed by type, which can trigger questions like “Do we have enough % of security tests” or “What should our % target be for functional tests?”.
• % of Automated Test Cases can be helpful if you are aiming to increase the number of automated tests, e.g. “We want to automate 40% of our test cases by the end of Q2”.
• Risk Coverage shows you how many of the risks identified in each test plan have test cases against them, which can trigger questions like “Why is the Risk Coverage below 50% on this test plan?” or “How can we test that we are mitigating more risks on this test plan?”.
• Test Cases by Owner and Status shows you the test case ownership distribution, which can trigger questions like “Why do we have so many test cases without an owner?” or “How can we better distribute test cases amongst the team?”.
• Test Cases by Status and Owner shows you how test cases are progressing through the pipeline and who is working on what test cases.
• Test Cases Not Linked to a Test Suite can help you consider questions like “A big % of our test cases are not organised in test suites. How can we fix that?”.

Test Executions and Defects Dashboard

Above: Snapshot of the Test Executions and Defects dashboard.

The Test Executions and Defects dashboard shows information about the latest test executions and open defects, and can be filtered by Environment and Test Execution Date.

• Overall Pass Rate shows the percentage of test executions that passed each day, providing a high-level overview of the status of QA executions across the projects.
• Pass Rate by Test Type can help you understand what type of tests are uncovering the most quality issues, and where your team could focus their energies.
• Test Executions by Tester is helpful to get an overview of how the daily test executions are distributed across your team.
• Test Executions by Test Case Owner shows you who owns the tests being executed, which can help you distribute test case ownership more efficiently amongst the team.
• Open Defects can be used to see if the number of open defects is between the set thresholds.
• Open Defects by Priority provides information that can help you understand at a quick glance how the most important defects are being fixed.
• Open Defects by Impact quickly shows you the distribution of open defects depending on their impact on the business.