Run results options

When viewing test run results in the dashboard or report, you can select additional options for using, saving, and sharing the results data.

Where do I find it?

When viewing the dashboard or report for a load test run, in the menu bar click (more options) and select the required option from the menu.

Back to top

Open a defect in ALM Octane

You can configure StormRunner Load so that you can open a defect in ALM Octane directly from a StormRunner Load report.

Configure ALM Octane in StormRunner Load

To configure StormRunner Load to work with ALM Octane:

  1. Navigate to Menu bar > Your user name > ALM Octane account.

  2. In the dialog box that opens, enter the URL to the home page of your Octane account.

Create a defect from StormRunner Load

To open a defect in ALM Octane directly from the dashboard or report:

  1. Click (more options) and select Open defect in ALM Octane.

  2. In the dialog box that opens, enter the following details for the defect:
    • Name

    • Workspace

    • Severity

    • Description

  3. Click Submit.

Back to top

Email a results report

To email a report of the load test run results, click (more options) and select Email report. In the dialog box that opens, enter the recipient email address and any message content you want to include. To send to multiple recipients, separate the email addresses with a semi-colon.

The report is sent as a pdf attachment to the message.

Back to top

Set a benchmark

You can set a load test run as a benchmark, so that in the dashboard, you can visually compare another run to it.

To set a run as a benchmark, click (more options) and select Set as benchmark.

For details on using the benchmark in the dashboard, see Compare to a benchmark run.

Note: This option is currently not available in the new dashboard and report (beta).

Back to top

Export a results report

You can export a report of the load test run results in different formats. To export a report, click (more options), select Export and then select the required option.

Note: You can export a maximum of three .pdf and .csv files simultaneously.

Export as PDF

After you select Export > Report to PDF the export begins.

  1. In the menu bar, click to open the Notification area.

  2. The notification entry for the export shows whether the export is still in progress or if it has completed.

  3. If it has completed, click the Download button in the notification entry to download the .pdf file.

    Note: The .pdf file is available for download for one week. After this time the export is marked as expired.

  4. Optionally, you can view more details about the export by clicking the arrow to the right of the notification entry.

Export as Word

Select Export > Report to Word to export the results to a .docx file.

Export as CSV

Note: This option is also available for a load test run in the Results page.

  1. Select Export > Results to CSV to export the results to a .csv file.

  2. From the dialog box, do the following:

    Action How to

    Select a time frame

    Use the time slider to specify the time frame to export.

    Select metrics Select which metrics to include in the report.
    Calculate

    Based on the time frame and metrics selected, calculate the highest level of data granularity (in seconds) available.

    Note: The shorter the time frame and the fewer metrics selected, the higher is the level of data granularity available.

    Set data granularity

    Specify the number of seconds between each data point by entering a multiple of the calculated data granularity available.

    Export Start the export to a .csv file.
  3. Download the .csv file.

    1. In the menu bar, click to open the Notification area.
    2. The notification entry for the export shows whether the export is still in progress or if it has completed.
    3. If it has completed, click the Download button in the notification entry to download the .csv file.

      Note: The .csv file is available for download for one week. After this time the export is marked as expired.

    4. Optionally, you can view more details about the export by clicking the arrow to the right of the notification entry.

The following table summarizes the data columns contained in the file.

Column name Description

time_stamp

The network time stamp (in milliseconds).

Tip: In Excel, to convert the time stamp to a time format, use the following formula: =<Timestamp>/1000/86400 and set the cell format to Time with the following type: *13:30:55

clock_time The real time stamp based on the ISO 8601 standard.
metric The name of the metric. For example, Running Vusers or ATRT.
val The value of the metric.
dim1, dim2, dim3... Depending on the metric type, other values are exported. For example, geographic area, script name, server name, or transaction name.

Back to top

Export an NV Insights report

If you configured a load test to generate an NV Insights report, you can export the report to an .html file.

To export the report, select Export > NV Insights report.

For further details on the NV Insights report, see Single user performance reports.

Export raw script error data

You can configure a load test to store all the script error messages generated during a test run, in raw format. You can then export this information to a .csv file.

To configure a load test to store all the script error messages, select the load test's General settings > Store extra data for export > Store script errors check box.

To export the error messages to a .csv file, select Export > Script errors to CSV.

Note:  

  • This option is supported for on-premises load generators version 3.5 and later.
  • The report includes a column for transaction ID. This column is populated only for MDRV script protocols.

Back to top

Export raw transaction data

You can configure a load test to store transaction data generated during a test run, in raw format. You can then export this information to a .csv file.

To configure a load test to store transaction data, select the load test's General settings > Store extra data for export > Store transactions raw data check box.

To export raw transaction data to a .csv file, select Export > Transactions to CSV (Raw).

Note:  

  • This option is supported for on-premises load generators version 3.6 and later.
  • Only transactions that passed are included.
  • Transaction groups are not included.
  • A maximum of 100 million entries can be stored.
  • The data is retained for one week, after which it is automatically purged.

Back to top

Download test run information

You can download various information about a test run. To download this information, click (more options), select Download and then select the required option.

Download logs

You can configure load tests to generate logs from the load generators used in the test, which you can then download.

To download load generator logs that were generated, select Download > Logs. The logs are downloaded to a .zip file.

For details on configuring a load test to generate logs, see Enable logs.

Note:  

  • The maximum log file size is 512 MB for on-premises load generators and 1 GB for cloud-based load generators. Log files that exceed the maximum size are not included in the downloaded logs for a test run.
  • The total size of all the log files included in a download cannot exceed 15 GB.

Download load generator IPs

To download a list of cloud-based load generators that have been assigned to a test, select Download > LG IPs. The data is downloaded to a .csv file and includes the IP address, type, region, and location.

Download load generator script assignment

For an on-premises based load test, you can download a list of the load generators to which the scripts in the load test were assigned.

To download the assignments, select Download > LG Scripts. The assignments are downloaded to an Excel file that shows the names of both the on-premises load generator, and the assigned script.

For details on assigning scripts to run on specific on-premises load generators for a load test, see Enable script assignment.

Back to top