Plan and run test suites

After you create a test suite, run it with different configurations. Plan a suite run, assign the test runs to different users, and view the results after all the tests are complete.

Watch a video!

Plan a test suite run

If you have a complete test suite ready but are unsure when it is possible to run the suite, plan the run. This ensures that the suite's run configuration is set but gives the owner the freedom to run the test suite when it is convenient.

To plan a test suite:

  1. In the Quality module, select the Tests tab.

  2. In the grid, select a test suite and in the toolbar, click Plan Run .

  3. In the Plan Suite Run dialog box, define the suite run attributes. ALM Octane assigns the values to all test runs for the tests in the suite.

  4. Click Plan. ALM Octane creates the suite run and the test runs for the suite's tests. ALM Octane displays the test runs in the Default owner's item list in the My Work module.

Tip: To add a test to a planned suite run, first add the test to the test suite, then right-click the test in the Tests tabs and select Add to Suite Run.

After you plan a test suite run, ALM Octane adds a Planned tag to the available Run Status tags in the Tags tab.

Back to top

Run a test suite

When you run a test suite, the test suite runs as a collection of test runs. Assign test runs to different owners and environments.

The test suite run process follows these steps:

To run a test suite:

  1. Plan the test suite run. In the Tests tab of the Quality module or the Tests tab of a feature or story in the Backlog module, select the test suite to run.

  2. In the toolbar, click the Plan Suite Run button.

    Tip: If you want to run all the tests as a one-time run, click the Run Test Suite button and enter the run attributes. The tests are run in order.

    If the suite contains executable automated tests, ALM Octane triggers the run on the CI server in parallel to the manual run.

  3. Assign suite run attributes. In the Plan Suite Run dialog, provide the suite run attributes.

    When you have entered these details, click the Plan and Edit button to continue.

  4. In the test suite, select the Suite Runs tab. ALM Octane displays a list of all suite runs.

  5. In the list of suite runs, click on the link for your planned run. ALM Octane displays the suite run details.

  6. In the suite run, click the Runs tab. ALM Octane displays a list of all tests included in the suite.

  7. Assign owners and attributes. In the list of test runs, in the Run by and Environment fields, assign the test to the relevant user and specify the environment on which to run the test.

    Environment is an information label. ALM Octane does not select or detect the environment on which the test runs.

    Tip: Update multiple test runs with the Bulk Update context menu option.

    After you assign all the tests, the Runs tab displays the updated list:

    The owner of the test run receives a notification of the assignment in the My Work area of ALM Octane.

    Tip: If you want to run a test twice as part of a suite run, in the Runs tab, select the test and click the Duplicate Run button . ALM Octane adds the same test to the list of tests.

  8. Run the tests. Each assigned owner runs the tests as normal. For details, see Run manual and Gherkin tests.

    Owners run the tests from one of the following:

    My Work module

    ALM Octane labels each assigned run with the name of the suite run and a link to the individual test:

    Select the test, and in the right pane of the My Work module, click Run Test to start the test run.

    Tip: If all tests in the suite are assigned to the same user, they appear in My Work as a suite run. Select the suite and, in the right pane, click Run Suite.

    From the Backlog or Quality modules

    In the Details tab or Runs tab of the suite run, click the Plan Suite Run button .

    If some tests are not assigned, select whether to run your assigned tests with the unassigned tests or all tests in the test suite.

    If someone must pause a test run, clicking the Continue Run button in the toolbar of the Details tab or Runs tab of the Suite Runs tab in the test suite to resume the test run.

Back to top

View the suite run results

When the suite's tests run, ALM Octane compiles the run results into a single report.

To view the suite run results:

  1. In the Test Suite, click the Suite Runs tab.

  2. In the list of suite runs, click on the link for the suite run you want to view.

  3. In the suite run instance, click on the Runs tab. ALM Octane displays the list of all runs.

  4. In the Runs tab, click the Report tab. The suite run report is then displayed:

    Scroll or click the links to view each test in the suite, as well as the specific steps in each test.

    The report also shows which phase each test was in when the run was created.

Back to top

See also: