Brief summary of this article:
If you perform regression test activities, you would probably need to quickly get an idea of the overall quality for your recent test plan runs. Last Test Runs Results Report can help you to visualize your current quality and plan QA and Development activities timely. The report is intended to be used with Testing Module in Targetprocess.
Test Plans in Targetprocess contain individual Test Cases. During execution of Test Plan Run, each Test Case is set into one of the following statuses: Failed, Passed, Blocked, On hold, Not run. This Visual Report displays the summary of test cases' statuses in the most recent run for every test plan. As a result you get a bar chart. Its vertical axis shows the count of passed, failed and skipped test cases. Bars on horizontal axis show test plans one by one or grouped by projects / releases / iterations (sprints) / builds / types of work items (assignable entities).
Last Run results summary for Test Plans
First report uses Test Plan Run as a base entity. The results are taken from the last run of test plans. Bars on horizontal axis show test plans separately.
The summary bars show recent Test Plan Runs in the selected projects, unless you narrow your data source with special filters.
How to create the Report
Click +Create > Report to start building new Visual report.
Create report from Blank template.
We recommend to use the following Sources settings as initial ones:
- Source type: Entity Reports
- Projects and teams: make required selection
- Entities: Test Plan Runs
Apply Filter for data source. Its purpose is to select just one most recent Test Plan Run per each Test Plan. Syntax of Advanced Filters is used.
?IsLastStarted is true
Press Create report button. Then use the following setup for the chart:
- Horizontal axis: Name
- Vertical axis: all or some of the fields together
- Passed Count
- Failed Count
- Blocked Count
- On Hold Count
- Not Run Count
- Chart Type: Stacked-Bar
Press Finish setup button. Your chart is ready!
Further Customization
Using Filters for Sources settings, you can narrow the data scope in order to take into account only selected Test Plans. Syntax of Advanced Filters is used. The following filters and combinations of them can be useful for this chart:
Entity | Filter | Result |
Test Plan Run | ?IsLastStarted is true and StartDate >= Today-90(days) | Test plan runs started for execution within last 90 days |
Test Plan Run | ?IsLastStarted is true and EndDate >= Today-90(days) | Test plan runs marked as done within last 90 days |
Test Plan Run | ?IsLastStarted is true and TestCaseRuns.Count > 0 | Non-empty test plan runs |
Test Plan Run | ?IsLastStarted is true and TestPlan is "General Test Plan" | Last run of "General" test plan |
Test Plan Run | ?IsLastStarted is true and "Regression" in TestPlan.Name | Last run of all test plans that have "Regression" word in the name |
You can also browse data source and apply filters to data using special interactive wizard in chart settings. Navigate Actions > Set up report menu item, and then press Data Source > Browse and filter button.
Last Run results summary grouped by date ranges / Project / Release / Iteration (Sprint) / Build / Entity Type
The report also uses Test Plan Run as a base entity. First report uses Test Plan Run as a base entity. The results are taken from the last run of test plans. Bars on horizontal axis show test plans grouped by projects / releases / iterations (sprints) / builds / types of work items (assignable entities).
In order to build the report, create Last Run results summary for Test Plans report in advance. We describe how to create it in this article above. Then customize the report additionally.
Instead of Name field, you should put special field to horizontal axis for grouping.
There are predefined fields that group test plans. Here we list them:
- Start Date / End Date
- Group by: Day / Week
- Appearance: Period
- Project
- Build
- Release
- Iteration / Sprint
- Team Iteration
These fields are related to the Test Plan Run entity itself. However it may happen that the Test Plan Run is executed for the Test Plan that contains Test Cases for assignable work items from multiple projects / releases / iterations (sprints). This model of data organization must be processed within more complex and smart calculations.
There are no predefined fields that could group test plans by projects / releases / iterations (sprints) of assignable work items. Add the required fields manually. Press Add field or formula button in Data fields list for this purpose:
Add fields with the following names and formulas:
Name | Formula | Group by |
AssignableProject | TestPlan.LinkedAssignable.Project.Name | Project of assignable work item |
AssignableRelease | TestPlan.LinkedAssignable.Release.Name | Release of assignable work item |
LinkedRelease | TestPlan.LinkedRelease.Name | Release, if you have special Release Test Plan |
AssignableIteration | TestPlan.LinkedAssignable.Iteration.Name | Iteration / Sprint of assignable work item |
LinkedIteration | TestPlan.LinkedIteration.Name | Iteration / Sprint, if you have special Iteration Test Plan |
AssignableTeamIteration | TestPlan.LinkedAssignable.TeamIteration.Name | Team Iteration of assignable work item |
LinkedTeamIteration | TestPlan.LinkedTeamIteration.Name | Team Iteration, if you have special Team Iteration Test Plan |
Type | TestPlan.LinkedAssignable.EntityType.Name | Entity type of assignable work item |
Further Customization
Using Filters for Sources settings, you can narrow the data scope in order to take into account only selected Test Plans. Syntax of Advanced Filters is used.
Examples of the filters by release, iteration, build:
?IsLastStarted is true and TestPlan.LinkedAssignable.Release.StartDate >= Today-90 (days) ?IsLastStarted is true and TestPlan.LinkedAssignable.Release.EndDate > '01-Jul-2017' and TestPlan.LinkedAssignable.Release.StartDate < '01-Oct-2017' ?IsLastStarted is true and Build.ID >= 2800
You can also browse data source and apply filters to data using special interactive wizard in chart settings. Navigate Actions > Set up report menu item, and then press Data Source > Browse and filter button.
More information
Visual Reports and Custom Graphical reports are very flexible in terms of filtering, grouping and customization. If you need to build some other Visual Report, you're welcome to contact our support team and request our assistance.
See Also
Still have a question?
We're here to help! Just contact our friendly support team.