Add automated tests

In ALM Octane, automated test entities represent a test from an external tool. Add these tests and view the tests with other manual tests.

Overview

Automated tests are usually run by CI or automation servers, such as Jenkins or TeamCity, or by ALM.

If you use UFT for automated tests, ALM Octane can create executable automated test entities based directly on UFT tests. For details, see Add UFT tests from an SCM repository.

The other way to add automated tests to ALM Octane is based on test run results. For details, see Creating automated test entities.

For ALM Octane to receive the test results, do one of the following, as described in the sections below:

Back to top

Creating automated test entities

ALM Octane receives automated test run results from pipelines, test result collection tools, or the API. ALM Octane creates automated test entities associated with the test run results, and adds the results to the tests as test run entities.

If the relevant automated test already exists, ALM Octane adds the results as a test run to that test.

For each test, ALM Octane stores the results of one run per test environment. If you run the test again with the same environment configuration, the new results overwrite the old.

If the test ran with different settings this time, ALM Octane stores the results in a new test run entity for the test.

ALM Octane maintains and displays basic information about the previous runs in a test run's Previous Runs tab, in dashboard trend widgets, and in a pipeline run's Tests tab.

Tip: When working with pipelines, you configure a test's environment by configuring the pipeline step that runs it. For details, see Label steps according to job type.

Back to top

Add UFT tests from an SCM repository

If you use UFT for automated tests, the DevOps admin can store your tests in Git or SVN and set up UFT integration. This lets you see your UFT tests reflected in ALM Octane as soon as you save them, regardless of test runs. For details, see Set up UFT integration.

ALM Octane creates executable automated test entities based on the UFT tests in the SCM repository. You can then run these UFT tests from ALM Octane as part of a test suite. For details, see Run UFT tests as part of a test suite.

Back to top

Add automated tests from runs in a pipeline

To add automated tests from test runs in an ALM Octane pipeline, perform the following steps:

  1. Set up CI servers

  2. Create and configure pipelines

  3. Run the pipeline that contains the tests.

The test run results are sent to ALM Octane. ALM Octane creates or updates the automated test entities associated with these results.

To enable the ALM Octane CI plugin to send the results to ALM Octane, make sure that the jobs running the tests publish them to the CI server. For example:

  • For StormRunner Load tests run by Jenkins, create a Publish JUnit test result report post build step.
  • For tests run by GoCD, declare the result xml-report-files as artifacts of your build.

Back to top

Add automated tests from external test runs

If you run automated tests on ALM, or on a CI server not integrated with ALM Octane, you can use the following to send your automated test run results to ALM Octane:

  • ALM Octane API 

  • Test Result Collection Tools

ALM Octane creates or updates the automated test entities associated with these results.

For details, see Push results to ALM Octane.

Back to top

Assign tests to application modules and backlog items

Assigning automated tests to application modules and backlog items in ALM Octane lets you view the test results in context. You can then use these results to analyze the progress and quality of your release and product.

Assigning owners to automated tests helps accelerate problem resolution. You can configure a pipeline to notify test owners when their test runs fail.

For details on defining application modules or creating your product backlog, see Work with application modules and Build the product backlog.

To manually assign tests:

  1. In ALM Octane, in the Tests tab (Quality or items of a Backlog module), click a test's link to open it.

  2. In the Backlog coverage field, select the relevant backlog items.

  3. In the Application modules field, select the relevant application modules.

  4. In Owner, select the relevant user.

To manually assign multiple tests:

  1. In ALM Octane, in the Tests tab, select the relevant tests.

  2. Do one of the following:

    • Click Assign to Application Module and select the relevant application modules.

    • Right-click and select Bulk Update. Click Select field, select Application modules or Owner, and apply the relevant values.

To set up rules that automatically assign automated tests:

  1. In the DevOps > Test Assignment Rules setting page, set up rules to assign automated tests that match a filter you specify to specific application modules.

  2. When you save a rule, ALM Octane assigns all current and future automated tests that match the filter to the selected application modules and test owner. This includes tests currently in the system, as well as new automated tests discovered in the future.

    For details, see Create and manage test assignment rules.

Tip: Use the same rules to assign owners to automated tests, which can help accelerate problem resolution.

You can also create test assignment rules from the Backlog or Quality modules. For details, see Create and manage rules to assign automated tests.

Back to top

Next steps: