Send automated test run results to ALM Octane

Incorporate automated test results into ALM Octane even if you do not use a CI server.

When ALM Octane receives test results, it creates automated test and test run entities from the results. For details, see Creating automated test entities.

Set up API access

In order for the ALM Test Results collection tool to send results to ALM Octane or for you to send results via the ALM Octane UI, you must have permissions to access the server. ALM Octane grants this permission with an API access key.

For details on setting up API access, see Set up API access.

Back to top

Prepare your test results

Store your automated test results in a valid XML file. Use one of the following formats:

A JUnit test results XML file

Use the XML schema used by JUnit tests.

To view the full XML schema, see https://github.com/windyroad/JUnit-Schema. For a description of the schema elements, see https://www.ibm.com/support/knowledgecenter/en/SSQ2R2_9.5.0/com.ibm.rsar.analysis.codereview.cobol.doc/topics/cac_useresults_junit.html.

To relate the test results to ALM Octane entities, add additional information about the tests (test type, environment details, release, and so on) in a separate configuration file or by using the command line options of the test result collection tools. For details, see the tool's readme.

An XML file using API requirements

If you have more complex cases, prepare the XML file according to the ALM Octane test result API. For details, see Add automated test results to ALM Octane.

For an example, see Test results XML sample.

Back to top

Decide how to send test results to ALM Octane

Use one of the following methods:

Test Results Collection Tool

This tool sends automated test results stored in an XML file to ALM Octane. These test results can be stored anywhere.

The tool requires an ALM Octane user name and password for authentication.

ALM Test Result Collection Tool

Retrieves the test results directly from ALM and sends them to ALM Octane. Define filters that specify the test runs whose results you want to retrieve.

The tool requires connection information for an ALM domain and project, as well as a user name and password and ALM Octane API access.

Supports 12.* versions of ALM. Send test results from ALM test types including MANUAL, UFT, LeanFT, and BPT tests.

Use the ALM Octane API

Use REST API calls to send test results to ALM Octane without the test results collection tools.

For details, see Add automated test results to ALM Octane.

Back to top

Download a Test Result Collection tool

  1. In Settings , click Spaces and select a workspace.

  2. Click the DevOps tab. Then, in the left side of the pane, select CI Servers.

  3. Click the link to download the Test Result Collection tool or the ALM Test Result Collection tool.

    Save the download to a directory of your choice.

  4. Unzip the downloaded file and move it to the necessary directory.

Back to top

Push results to ALM Octane

To push test results stored outside an ALM server or on an ALM server, use the command line to run the test result collection tool. The command line options for this tool enable you to provide the necessary results, metadata, and configuration options as part of the command line or in a separate configuration file.

For details, see the readme files:

Back to top

Track your test results in ALM Octane

Within ALM Octane, there are a number of fields available to find your test results. Add these fields in the module grids or Dashboard graphs:

To track test results:

  1. In the Backlog or Quality modules, add the Testing tool type column. By default, this column reports tests from the Manual Runner, Selenium, UFT, LeanFT, StormRunner Load, SoapUI, Protractor, LoadRunner, and Performance Center.

    Filter or sort the grid accordingly to see results from these testing tools.

  2. In Dashboard grids, filter by the Testing tool type attribute. ALM Octane sorts the graph to display tests with each testing tool type.

  3. For tests pushed from ALM, use the Component, Package, and Class Name columns in the Backlog and Quality modules. These columns are marked accordingly to identify the test results origin from ALM.

    In addition, test names in ALM Octane add an identifier to test name to show it originated in ALM.

  4. Once the test results are in ALM Octane, set up test assignment rules to assign retrieved test results to the relevant application modules and ALM Octane users. For details, see Create and manage test assignment rules.

Back to top

See also: