Run automated tests from ALM Octane

In ALM Octane, most automated tests run as part of a CI/CD pipeline. UFT tests that were discovered using UFT integration run as part of a test suite.

The tests are run by automation tools and the results are sent to ALM Octane.

  • When working with pipelines, CI servers such as Jenkins and TeamCity, run the automated tests.

  • When working with UFT integration, Jenkins manages the UFT machines, similar to Lab Management in ALM.

Run automated tests as part of a pipeline

If you set up CI server integration, ALM Octane receives the results of automated tests that run in a pipeline on your CI server. ALM Octane then creates or updates the relevant automated tests and test runs based on those results. For details, see Set up CI servers and How ALM Octane creates automated test and test run entities from test run results.

You can trigger pipeline runs from ALM Octane, but not individual test runs.

Note: If you do not run your automated tests on a supported CI server, you can still send automated test run results to ALM Octane. For details, see Send automated test run results to ALM Octane.

To run automated tests as part of a pipeline:

  1. Prerequisite: Set up a pipeline and run it, so ALM Octane discovers your automated tests.

    This includes setting up integration with your CI server, creating a pipeline in ALM Octane, and running it for the first time. For details, see Add automated tests from test runs in an ALM Octane pipeline .

  2. Running automated tests again: To run your automated tests again, and have the updated results sent to ALM Octane, you must run the whole pipeline. For details, see Run and analyze pipelines.

    This runs all automated tests included in steps of the pipeline.

  3. View run results. Open individual automated tests in the Backlog or Quality module to view their results, or open the Pipelines module to view details about all the tests in the pipeline.

Back to top

Run UFT tests as part of a test suite

If you set up UFT integration, ALM Octane continuously reflects any UFT tests and data tables that it discovers in your repository. This lets you plan and trigger UFT test runs from ALM Octane by including the tests in test suites. For details, see Set up UFT integration.

To run automated tests as part of a test suite:

  1. Prerequisite: Set up UFT integration so ALM Octane continuously discovers your UFT tests and data tables. 

    ALM Octane creates executable automated tests to represent the GUI and API UFT tests. You can run these tests from ALM Octane by including them in a test suite. Only UFT tests discovered this way are executable. For details, see Add automated UFT tests stored in Git.

  2. Add executable UFT tests to a test suite. In ALM Octane, open the Quality module or a Backlog module. In the Tests tab, add one or more executable automated tests to a test suite.

    For each test, you can specify a data table to use for parameterizing the test run. For details, see Create test suites.

    You can also create a mixed suite that contains manual and automated tests.

  3. Plan and run the test suite. For details, see Plan and run test suites.
  4. View run results.

    The run results are explained in detail in the report provided by UFT. For example, you can find the name of the test, the UFT machine that ran it, the duration of the run, the data table and parameters that it used, details about the success or failure of each step.

    To view the run status and run results report:

    1. In ALM, in a test suite, open the Suite runs tab.

    2. Click the ID of a suite run to open it.

    3. In the suite run, open the Runs tab to view all of the test runs.

      While the test is running, the run status is In progress. After the run finishes, the results are available in the UFT report and the status shows Passed or Failed.

      If the test runs finished and the status still shows In progress, try refreshing the list of runs.

    4. Click the ID of a test run to open it for more detailed results.

    5. Click the Testing tool report button in the upper right corner of the test run to open the UFT report. The image below shows an example of a UFT report:

Troubleshooting a UFT test run

If ALM Octane failed to run an executable automated test that is included in a suite run:

  1. Check the UFT report for details about why the test failed.

  2. Make sure you set up UFT integration correctly. For details, see Set up UFT integration.

  3. Make sure that the UFT machine is not logged off or locked.

    Tip: If you install UFT version 14.01, you can run UFT tests when the computer is locked, as long as you configured the disconnected remote connection option.

  4. For more details on automated test run failures, see Examine failures from test runs.

Back to top

See also: