Monitor and measure product quality using the Quality module.
The Quality module is based on an application modules tree. The application modules tree is a logical depiction of the product, reflecting the product's functional areas. It is typically defined by the business analyst. The application modules tree shows how the application is broken down and allows you to track quality by logical business areas.
The Quality module includes tests, defects, and features, all of which can be associated with application modules to help you analyze quality by business areas, locate pain-points in your product, and concentrate your efforts in these areas. For details, see Assign items to application modules.
When deciding how to structure your application modules, focus on areas of the product for which you want to track quality, how you structure the application, and how users use the application.
Note: In workspaces that are members of a shared space, space admins can create shared application modules. Shared application modules are inherited by all the workspaces in a shared space. For details, see Shared items.
Define your product areas as application modules.
To build the application module tree:
Open the Quality module.
In the application modules pane, click the Add Application Module button.
Click Shared Application Module to create an application module that will be available across all the workspaces in a shared space.
In the Add Application Module dialog box, enter the required information.
If you selected an item in the tree, it is used as the parent item. You can drag items to rearrange the tree.
Repeat as necessary to create the full tree.
Building the application module is typically a process that requires a number of iterations. Drag and drop items to restructure the tree.
To display a subset of the application modules in the tree, click the Filter button. Choose whether to display only shared application modules, or selected application modules from the tree.
The root Application Modules node now aggregates only those items remaining in the filtered tree. This is reflected in the content included in the Overview, Tests, Features and Defects tabs when you select the root Application Modules node.
You can use the filter to narrow down the application modules tree.
To filter the application modules tree:
- Turn on Show only shared application modules to display only those modules that are inherited by all workspaces in the shared space.
- Turn on Show only selected application modules to display only the modules you have selected.
Click Sort > Add sorting field to sort the application modules according to selected properties.
Assign features, tests, and defects to application modules to help you assess product quality.
To find unassigned items, click Unassigned in the application modules tree.
To assign a single item:
Set the Application modules field in the item.
To assign multiple items:
- Open the relevant items' tab in the Backlog or Quality module, and select the required items.
- In the toolbar, click the Assign to Application Modules button.
In the dialog box, select the relevant application modules, and then click OK.
If you are assigning automated tests, click Assignment Rule to create a rule that assigns automated tests. For details, see To create test assignment rules from the Tests tab.
Use the Quality by Application Module widget in the dashboard to see an overview of the application modules and identify those that need attention. You can choose application modules, filter by application module fields, and configure the threshold for switching an area from On track to Needs attention.
In the following example, the size of the application module in the widget is determined by the number of story points developed in the release and Needs attention is determined by critical open defects, low automation, or risky commits.
Trace tests to application modules
The following is a typical example of test traceability of a manual test.
- The backlog owner creates a new feature and assigns it to an application module.
- A tester creates a manual acceptance test for the feature (or one of its user stories) in the Backlog module. The test automatically inherits the feature’s application module.
- Access the test from the feature to understand feature coverage, and from the application module to understand the area coverage.
When working with ALM Octane, it is useful to see anomalies in order to prevent delays in the development cycle. Examples of anomalies are defects stuck in one phase for a extended period of time, or a defect reassigned to many users.
Admins can define rules that flag anomalies within ALM Octane entities. For details, see Set up anomaly flags.
Once your admin has set up the anomaly flags, add the Flag rules column to your entity grid. It will show the anomaly if it is present. The tooltip shows details about the anomaly's threshold.
Available in versions: On-premises 15.1.60 and later, SaaS 16.0.200 and later
The Runs tab provides a unified grid of runs across all tests, both planned and executed. You can filter the grid as you like, and perform bulk updates on runs across different tests.
Default display limits
Some filter settings in the Runs tab can result in a huge number of matching runs, leading to performance problems. The Runs tab is therefore limited to 2000 runs by default.
If your filter definition matches more than 2000 runs, the result depends on the field you are sorting by:
If you are sorting by a field that is indexed in your database (for example ID, Creation time, or Started), ALM Octane shows the first 2000 runs, and a message at the bottom of the grid indicates that there are more results.
If you are sorting by a non-indexed field, a message indicates that there are too many results to display, and you should refine your filter.
If needed, the site admin can contact a DBA and ask to index a necessary field that is currently not indexed.
Note: If your filter exceeds this limit, refine your filter to generate fewer than 2,000 records. If this limit is too restrictive for your environment, please contact Support.