How to Create Test Sets
This task describes how to create and define test sets in the Test Lab module.
To learn more about test sets, see Test Set Specification Overview.
Note: Higher-level task: This task is part of a higher-level task. For details, see Run tests in ALM.
-
Define a hierarchical framework for your test sets by creating a test sets tree that contains folders and subfolders.
-
Open the Test Lab module. On the ALM sidebar, under Testing, select Test Lab.
-
Create folders. Right-click the Root folder and select New Folder. To create a sub-folder, right-click a folder and select New Folder.
-
Add test sets to folders. Right-click a folder and select New Test Set. For user interface details, see New Test Set Dialog Box.
To learn more about the different types of test sets, see Test Set Specification Overview.
Example:
Suppose you want to test new features added to Release 10.5 of the Mercury Tours application. Release 10.5 consists of four cycles, and you want to test the new features for the release in Cycle 1, Cycle 2, and Cycle 4. Because the tests you need to run to test the new features are the same for each of these cycles, you want to use the same test set as a basis for testing new features in each of the cycles.
In the test sets tree, you can create the folder, Release 10.5,for the release. Under this folder, you create the folder, Cycle 1, for the first cycle of the release. In the Cycle 1 folder, you create a test set, New Features, containing the tests necessary to test new features for the release. After you create this test set and add its tests, you can copy and paste the Cycle 1 folder and use it as a basis for the other cycles that test new features.
-
-
Assign test set folders to cycles
Assign test set folders to cycles defined in the releases tree in the Releases module.
Right-click a test set folder and select Assign to Cycle.
-
Add tests to test sets
In the Test Lab > Test Sets tab, select a test set and click the Execution Grid tab or the Execution Flow tab. Then click the Select Tests button. Add tests from the following tabs in the Select Tests pane:
-
Test Plan Tree. Add tests from the test plan tree to the test set.
-
Requirements Tree. Add tests covering requirements from the requirements tree to the test set.
For user interface details on the Select Tests pane, see Select Tests Pane.
-
-
Configure execution settings for a test instance
Note: This option is not available for Performance test sets.
You can view or set the test parameter values for a manual or automated test instance. You can choose a remote host on which to run the manual or automatic test instance. You can also view and edit the On Failure rules for an automated test instance.
-
In the Execution Grid or the Execution Flow, right-click a test and select Test Instance Details.
-
In the Test Instance Details dialog box, click Execution Settings on the sidebar. For user interface details on the Execution Settings view, see Test Instance Details - Execution Settings View.
-
-
Specify host criteria for a test instance in a Functional test set
Note: This option is not available for Default test sets.
You allocate a testing host for a test by specifying criteria in a host reservation. You can reserve a particular host from the project host pool. Alternatively, you can provide ALM with criteria from which to dynamically select hosts from the host pool allocated to your project. Host criteria include host purpose, location, and attributes.
-
Select a test instance.
-
In the Test Instance Details dialog box, choose a set of criteria from the options listed in the Testing Host field.
For user interface details, see Test Set Specification Overview.
For details about testing hosts in ALM, and managing testing hosts in Lab Management, see Manage lab resources.
-
-
Manage host requests for a Functional test set
Note: This option is not available for Default test sets.
To alter the types of hosts you requested for an entire test set, use the Requested Hosts tab. You can modify, add, or delete host requests for the entire test set.
Select a test set, and click the Requested Hosts tab. For user interface details, see Requested Hosts Tab.
-
Set notification rules
Set notification rules to instruct ALM to send email to a specified user if selected events occur for a test set.
You set notification rules in the Automation tab, Notification area. For user interface details, see Automation Tab.
-
Set On Failure rules
Set On Failure rules to define what action ALM takes in the event that an automated test in the test set fails.
You set notification rules in the Automation tab, in the On Automated Test Failure area. For user interface details, see Automation Tab.
-
Request test result summary report
You can request that a summary of test results is sent in an email to specified users when test set execution completes.
Enter details in the Automation tab, in the Execution Summary area. For user interface details, see Automation Tab.
-
Pin a test set to a baseline - optional
You can pin a test set to a baseline to associate the test set with the versions of the tests stored in a baseline you select.
-
In the Test Lab module, right-click a test set and select Pin to Baseline. For user interface details on the Select Baseline dialog box, see Select Baselines Dialog Box.
-
To clear a pinned baseline, right-click a test set and select Clear Pinned Baseline.
For concept details on pinned test sets, see Pinned Test Sets.
-