Test Runs

After running tests, you can view the results in the Test Runs module of ALM Desktop Client. The Test Runs module contains tabs which let you study the results of test instance runs, test set runs, and build verification suite runs.

Note: This task is part of a higher-level task. For details, see Test Lab.

Test runs overview

The Test Runs module enables you to view test run results of manual test instances, functional test sets, and build verification suites.

What you can do Details
View run results for test instances

After running a test, you can analyze the execution results to determine which steps succeeded and which tests failed.

For details, see View results of a test instance run.
View run results for functional test sets

After running a functional test set, you can analyze the test set results to determine which tests in a test set failed, and which steps caused the failure.

Available for: Projects with the lab extension enabled.

For details, see View results of a functional test set run
View run results for build verification suites

After running a build verification suite, you can analyze the build verification suite results to determine which test runs in a build verification suite failed, and which steps caused the failure.

Available for: Projects with the lab extension enabled.

For details, see View results for a build verification suite run.

Back to top

View results of a test instance run

After running a manual or automated test, you can view results and general information of the test run. You can view test run details, compare the results of the most recent test run with previous runs, manage attachments, view and edit test run configuration information, manage linked defects, and view a history of test run changes.

To view results of a test instance run:

  1. On the ALM sidebar, under Testing, select Test Runs. Go to the Test Runs tab.

    Filter and sort the grid to display only those runs that meet your criteria.

    Example: You can define filters to display:

    • Tests that are currently running

    • Failed runs

    • Runs executed this month

    For user interface details on filtering data, see Filter dialog box.

  2. To export the selected or all runs as a text file, Microsoft Excel worksheet, Microsoft Word document, or HTML document, click Edit > Export, and select Export All or Export Selected.

  3. To view the details of a test instance run, click the Run ID.

    The results available for automatic tests vary depending on the test type.

    UI Element

    Description
    Details

    Displays details of the run.

    Report

    Displays results and test step details of the run.

    • For automated test instances, also includes one of the following:

      • Opens and displays the results in LoadRunner Analysis. Available for the LR-SCENARIO test type.

      • Opens and displays the report in UFT One . Available for the GUI-TEST test type. The Launch Report button is only enabled if you have installed the UFT One Add-in.

      • Collected System Info link. Opens the System Information dialog box. Displays the collected system information, such as CPU, memory, and processes running on the machine when the test is run. Available for the SYSTEM-TEST test type.

      • Captured Desktop Image. Opens the captured image of the machine executing the system test. Available for the SYSTEM-TEST test type.

    • For external type tests (EXTERNAL-TEST), also displays the following links:

      • Opens Jenkins and displays the run results.
      • Opens the file system and displays the run results and additional test data (for example, snapshots). This path is defined in the Importing External Test Results dialog box. For details, see Import External Tests.
    Results

    LoadRunner Enterprise: Enables you to manage result files generated during the selected test run
    Steps

    Displays test step details and results for the run. To view detailed results of a step, select a step from the grid and click the Details button.

    Note: Not available for runs of some test types and runners.

    Attachments

    Lists existing attachments and enables you to add new attachment. For details, see Work with attachments.
    Parameters

    Displays the manual test parameters that are used in the test steps.

    Linked Defects

    Lists the defects already linked to the run and enables you to link new or existing defects to the run. For details, see Link defects to test runs.
    History

    Displays a list of changes made to the run. For details, see Display ALM history.
    Criterion Results

    Displays the results of the last test criteria run for the selected business process test.

    Business Process Testing: Functionality related to test criteria is available only for business process tests. For details, see Create requirement coverage for flows and business components.

    Iterations

    Displays the status of each iteration for the selected business process test.

    Business Process Testing: Functionality related to iterations is available only for business process tests. For details, see Define iterations for components, flows, and groups.

  4. To view the details of a run step, open the run details. In the Steps tab, select a step and click Details.

    Note: The Run Step Details dialog box is not available for Sprinter runs.

    UI Element Description
    Details

    Displays details of the step.

    Attachments

    Lists existing attachments and enables you to add new attachment. For details, see Work with attachments.
    Linked Defects

    Lists the defects already linked to the step and enables you to link new or existing defects to the step.
  5. (For manual test runs only) To continue a manual test running, select the run, and click Continue Manual Run.

  6. To stop the execution of a run, select the run, and click Stop Run.

    The Stop Run button is enabled only when the selected run is in the Initializing, Running, or Stopping status.

Back to top

View results of a functional test set run

Available for: Projects with the Lab extension enabled.

After running a functional test set, you can analyze the test set results to determine which tests in a test set failed, and which steps caused the failure. You can also stop a functional test set.

To view results of a functional test set run:

  1. On the ALM sidebar, under Testing, select Test Runs. Go to the Test Set Runs tab.

    ALM Editions: The Test Set Runs tab is available only for ALM Edition. For information about ALM editions and their functionality, see ALM editions. To find out which edition of ALM you are using, ask your ALM site administrator.

  2. To export the selected or all test set runs as a text file, Microsoft Excel worksheet, Microsoft Word document, or HTML document, click Edit > Export, and select Export All or Export Selected.

  3. To view the details of a test set run, click the Run ID.

    UI Element

    Description
    Details

    Displays details of the test set run.

    Event Log

    Displays a list of the events that were logged during the test set run. For details, see Event Log.

  4. To see the execution report of a test set run, select the run and click Show Report.

    For details on the execution report, see Execution Report Page.

  5. To see a soft copy of an executed run, select the run and click Export Report.

    Note: You can also see the execution report of a test set run by clicking the Last Run Report button in the Execution Grid tab in the Test Lab module.

Back to top

View results for a build verification suite run

Available for: Projects with the Lab extension enabled.

After running a build verification suite, you can analyze the build verification suite results to determine which test runs in a build verification suite failed, and which steps caused the failure. You can also stop a build verification suite run.

To view results of a build verification suit run:

  1. On the ALM sidebar, under Testing, select Test Runs. Go to the Build Verification Suite Runs tab.

    ALM Editions: The Build Verification Suite Runs tab is available only for ALM Edition. For information about ALM editions and their functionality, see ALM editions. To find out which edition of ALM you are using, ask your ALM site administrator.

  2. To see the execution report of a build verification suite run, select the run and click Show Report.

    For details on the execution report, see Execution Report Page.

  3. To see a soft copy of an executed run, select the run and click Export Report.

    Note: You can also see the execution report of a build verification suite run by clicking the Last Run Report button in the Build Verification module.

Back to top

Link defects to test runs

You can view, add, and remove defect links for test runs and test run steps.

To add linked defects:

  1. From the Test Runs module, open a test run.

  2. In the Run Details dialog box, go to the Linked Defects tab.

    To add linked defects to a test run step, in the Run Details dialog box, select the Steps tab, select the step, and click Details. Go to the Linked Defects tab.

  3. To add and link to a new defect, click Add and Link Defect. Provide the defect details.

  4. To link to an existing defect, click Link Existing Defect and select one of the following options:

    • By ID. Enter the defect ID.

    • Select. Select the defect to link.

Note:  

  • Defects linked to a run step are indirectly linked to the run.

  • You can remove direct defect links only.

For details, see Defects Overview.

Back to top

Delete test runs

You can delete old runs no longer in use from your project.

To delete a run, select the run and click Delete.

Alternatively, you can delete one or more runs by purging test runs. See Test Runs.

Note:  

  • You cannot delete test runs which are part of a currently running test set run or build verification suite run.

  • If you delete a test set run or build verification suite run, the underlying test runs are deleted. Similarly, if you delete a build verification suite run, the underlying test set runs are deleted.

Back to top

See also: