Test assignment rules
Create test assignment rules to automatically assign application modules, test owners, and test fields to tests, using filter conditions.
Introduction
You can use test assignment rules to automatically populate automated tests with various details, based on filter conditions. This enables you to incorporate automated test run results collected from automation servers or other sources into the product quality analysis.
These rules impact both tests coming from pipelines, and tests coming from the testing framework. For details on the testing framework, see Trigger on-demand automated test runs.
When a test matches your filter criteria, the following information can be automatically assigned to the test: Application module, Test owner, Test framework, Test type, Test level, Testing tool, Test runner, Data access categories.
Create test assignment rules
When you create a test assignment rule, all current and future automated tests that match the rule's filter are assigned the selected values. This includes tests currently in the system, as well as new automated tests discovered in the future.
To create a test assignment rule:
-
Open the Settings menu and click Test assignment rules.
-
Click + Rule or + Assignment Rule.
-
In the Assignment Rule dialog box, give the rule a meaningful name. For example,
EndToEndTests
. -
In the Assign area, click + Add Assignment, and specify one or more of the following:
-
The application modules to which you want to assign automated tests.
-
A test owner to assign to the tests.
-
A test runner to be used for the next test run. For details, see Trigger on-demand automated test runs.
-
The test fields you want to assign (test framework, type, level, and testing tool).
-
Data access categories to assign to the tests. For details, see Data access control.
-
-
Click + Add filter to add conditions based on the values of the following fields: Class name, Component, Name, and Package.
Filters can be multipart and complex and can include '
*
' as a wildcard. If necessary, click + Add filter multiple times to add multiple items to the filter.Example:
- Name is equal to EndtoEnd*
- Component is not equal to *Internal
All conditions must be met for the rule to assign the selected values to an automated test.
-
In the Misc area, select whether the rule should assign application modules, test owner, and test runner even if those fields already have values, or only if they are empty. If the checkbox is selected, the specified application modules and test owner override the current values.
As you edit the rule, you can see how many currently existing tests will be modified after you save the rule.
-
Click Save.
The rule has the following effects.
Field Effect Application Module, Test Owner, Test Runner
These fields that match the filter affect both current and future tests.
This includes tests currently in the system, as well as new automated tests detected in the future. When you click Save, these fields are automatically updated based on the rule.
Test Framework, Test Type, Test Level, Testing Tool
These fields affect future runs, and are updated according to the latest run.
Fields in test runs triggered by testing framework These fields are updated according to the rule when they run. However, the tests themselves are not affected.
Note: If you do not want test assignment rules to affect future test runs in the testing framework, set the ENABLE_TEST_ASSIGNMENT_RULES_IN_SUITES site parameter to false.
Tip: You can also manage test assignment rules from the Tests tab of an item. For details, see Assign tests to application modules and backlog items.
Delete a test assignment rule
Test assignment rules can be deleted from the workspace settings. You must have the relevant permissions to delete a test assignment rule.
To delete a test assignment rule:
- Open the Settings menu , click Spaces, and select a workspace.
- Go to the DevOps tab.
- In the main pane, select Test Assignment Rules.
- Select the rule you want to delete.
- In the toolbar, click More > Delete.
Run test assignment rules
Test assignment rules run automatically:
-
As soon as a rule is saved.
-
Each time a new automated test is discovered.
Note: You cannot manually run a test rule.
Manage test assignment rules
In the DevOps tab, select Test Assignment Rules.
-
To edit a rule, click the rule ID link and modify its definitions as described above.
-
To sort, filter, group, delete, and export rules, use the toolbar options similar to other entities.
Example: When trying to understand why some tests are not properly being assigned, group or sort the rules according to the properties in the rule's filter. Then compare the properties in the rules to the properties of the test.
You can also edit rules in Settings > Test Assignment Rules.
See also: