Widget for Polarion: Test Coverage Overview

There are already multiple options to check the coverage between Requirements and Test Cases. However, having many options doesn't guarantee a solution that meets all your needs. We have a complete overview of the coverage with KPIs, allowing you to also see how many of the requirements are tested (not just covered).

Blog by Martin Bron.

ready to work with test coverage overview?

Preamble

For whom this could be interesting

Do you have to report on the progress of the implementation of requirements?
Are you in need of seeing the progress for sets of requirements?
Do you want to have an overview of the complete test coverage on 1 page?

a lot to see in 1 overview

Each row is for a set of requirements defined by you! This could be based a feature, chapter of a document (as displayed here), or Requirement Type (System, Software, …). The last line is the total/summary for all the lines that are evaluated. Each blue number is also a direct link to the Work Items counted.

Each column explained:

Description: Description for the entire line
# Requirements: All requirements found with the filter configured for that line
# Requirements covered by Test Cases: The number of Requirements that have 1 or more Test Case linked
# Requirements NOT covered by Test Cases: The number of Requirements that do not have a Test Case linked
% Requirements covered by Test Cases: KPI for the coverage
# Requirements tested: The number of Requirements with at least one test case has been performed as an indicator that the implementation of the requirement has started
% Requirements tested: KPI for the implementation of the requirements
# Requirements completely verified: Number of Requirements where all test cases are passed
# Requirements partially verified: Number of Requirements where at least 1 test case is passed and none have failed
# Requirements with failed Test Cases: Number of Requirements where at least 1 test case has failed
# Requirements to be verified: Number of requirements without any test case that has started testing
% Requirements completely verified: KPI for the successful implementation of the requirements
# linked Test Cases: Number of Test Cases that are linked to the Requirements
# of Test Cases passed: Number of Test Cases that are passed.
# of Test Cases failed: Number of Test Cases that have failed.
# of Test Cases blocked: Number of Test Cases that are blocked from testing
# of Test Cases not tested: Number of Test Cases that are on waiting
% of Test Cases tested: KPI for how much of the Test Cases have been performed
% of Test Cases passed: KPI for how much of the Test Cases have been successfully closed

Summary for management

When must present slides to management, you don’t always want to display all the numbers but more of an indication with just the KPIs:

Or want to dazzle them with pie charts.

And it is also possible to generate this data for just the last line and/or with trend diagrams.

word from our developer

While working for a Tier 1 automotive company, I was approached by a test lead. He needed more information to present for management for a specific project. Gathering the desired information was very cumbersome. So he asked me to develop this overview. After that, he was so happy with it that he started using it for all his projects. And when having to present data for management or the OEM, he could easily get screenshots from the latest information to update his presentations. He received a lot of praise for these simple overviews. Shortly after, all test leads were instructed to use this widget for getting screenshots for the presentations.