Defining Test Sets

In this exercise, you will define the Mercury Tours Site test set. You will also set failure rules for the test set to instruct ALM how to proceed in the event that an automated test in the test set fails. Depending on whether you are an ALM Edition user, you can either define a Functional test set or a Default test set.

Note:  

Defining a Functional Test Set

Functional test sets contain automatic tests. Tests in a Functional test set run using automated server-side execution.

To define a Functional test set:

  1. Display the Test Lab module.

    On the ALM sidebar, under Testing, select Test Lab.

  2. Add a folder to the test sets tree.

    1. In the test sets tree in the left pane, select the Root folder.

    2. Click the New Folder button. The New Test Set Folder dialog box opens.

    3. In the Folder Name box, type Service Pack 1 and click OK.

  3. Create subfolders for the test set folder.

    Select the Service Pack 1 folder and repeat the previous step to create two subfolders, named Cycle 1 - New Features, and Cycle 2 - Full.

  4. Assign the test set folders to a cycle.

    1. Right-click the Cycle 1 - New Features test set folder and select the Assign to Cycle button. The Select Cycles dialog box opens.

    2. Expand the Service Packs releases folder. In the Service Pack 1 release, select the Cycle 1 - New Features cycle (created in Lesson 2, Specify releases and cycles).

    3. Click OK. The icon for the folder in the test sets tree changes to show that the folder has been assigned to a cycle.

    4. Right-click the Cycle 2 - Full test sets folder and choose Assign to Cycle. Assign the folder to the Cycle 2 - Full cycle, located in the Service Pack 1 release in the releases tree.

  5. Add a test set to the Cycle 1 - New Features test set folder.

    1. In the test sets tree, select Cycle 1- New Features.

    2. Click the New Test Set button. The New Test Set dialog box opens.

    3. Enter the following:

      Name: Mercury Tours Site

      Description: This test set includes automatic tests that run on remote testing hosts and verify the functionality of the Mercury Tours site.

    4. Select Functional in the Type field.

    5. Click OK. The Mercury Tours Site test set is added to the test sets tree in the left pane.

  6. Define the Mercury Tours Site test set details.

    1. Click the test set in the test sets tree. The Execution Grid tab is displayed. Click on the Details tab.

    2. Select the following:

      Open Date: Select a date from the calendar for the planned opening date for the test set. Today's date is selected by default.

      Close Date: Select the planned closing date for the test set.

  7. Set rules for the automated tests in the test set in the event of a test failure.

    1. Click the Automation tab.

    2. In the On Automatic Test Failure section, perform the following:

      • Select the Rerun test check box.

      • Set Maximum test reruns to 1.

  8. Instruct ALM to send an email to specific users if certain events occur.

    Under Notification, perform the following:

    1. Select the check box to send an email notification if any test in the test set fails.

    2. To: Enter your email address.

    3. Message: Type the following:

      This test failed. Please review the test results and submit a defect.

Back to top

Defining a Default Test Set

Default test sets contain automatic and manual tests. You start and control tests in a Default test set using your local machine.

Note: In this exercise, you define a Default test set. If you are using ALM Edition with Lab Management enabled, you already defined a Functional test set. You can proceed to Adding Tests to a Test Set.

To define a Default test set:

  1. Display the Test Lab module.

    On the ALM sidebar, under Testing, select Test Lab.

  2. Add a folder to the test sets tree.

    1. In the test sets tree in the left pane, select the Root folder.

    2. Click the New Folder button. The New Test Set Folder dialog box opens.

    3. In the Folder Name box, type Service Pack 1 and click OK.

  3. Create subfolders for the test set folder.

    Select the Service Pack 1 folder and repeat the previous step to create two subfolders, named Cycle 1 - New Features, and Cycle 2 - Full.

  4. Assign the test set folders to a cycle.

    1. Right-click the Cycle 1 - New Features test set folder and select the Assign to Cycle button. The Select Cycles dialog box opens.

    2. Expand the Service Packs releases folder. In the Service Pack 1 release, select the Cycle 1 - New Features cycle (created in Lesson 2, Specify releases and cycles).

    3. Click OK. The icon for the folder in the test sets tree changes to show that the folder has been assigned to a cycle.

    4. Right-click the Cycle 2 - Full test sets folder and choose Assign to Cycle. Assign the folder to the Cycle 2 - Full cycle, located in the Service Pack 1 release in the releases tree.

  5. Add a test set to the Cycle 1 - New Features test set folder.

    1. In the test sets tree, select Cycle 1- New Features.

    2. Click the New Test Set button. The New Test Set dialog box opens.

    3. Enter the following:

      Name: Mercury Tours Site

      Description: This test set includes automatic and manual tests that verify the functionality of the Mercury Tours site.

    4. Select Default in the Type field.

    5. Click OK. The Mercury Tours Site test set is added to the test sets tree in the left pane.

  6. Define the Mercury Tours Site test set details.

    1. Click the test set in the test sets tree. The Execution Grid tab is displayed. Click on the Details tab.

    2. Select the following:

      Open Date: Select a date from the calendar for the planned opening date for the test set. Today's date is selected by default.

      Close Date: Select the planned closing date for the test set.

  7. Set rules for the automated tests in the test set in the event of a test failure.

    1. Click the Automation tab.

    2. Perform the following:

      • On Automatic Test Failure: Select the Rerun test check box. In Maximum test reruns, set to 1.

      • On final failure: Make sure that the Do nothing option is selected.

  8. Instruct ALM to send an email to specific users if certain events occur.

    Under Notification, perform the following:

    1. Send email in the event of: Select the first check box to send email notification if any test in the test set fails.

    2. To: Enter your email address.

    3. Message: Type the following:

      This test failed. Please review the test results and submit a defect.

Back to top