Run summary

The Run Summary displays an overview of the selected run, together with a summary of all transactions in the run. The page provides a high-level view of the outputs of the run, so that you can validate test performance by determining if the run is at the expected level. If the run is valid, you can then proceed to an in-depth analysis to ensure that the tested services are executed successfully under the defined load.

In this topic:

Open the Run Summary

The Run Summary page provides a summary of the selected test run.

The following items are included in the run summary:

• Test run general details

• Results pane

• Transactions grid

To open the Run Summary page:

1. Select a run to analyze as described in Select a run for analysis.

2. The Run Summary page for the selected run opens and displays the run information.

3. To quickly navigate back to Runs page, click the Runs link in the breadcrumbs.

Back to top

Test run general details

The summary details pane provides general information about the selected test run.

Details	Description
<Test name>	The test name as displayed in the l load testing tool.
<Test run ID>	The test run ID as displayed in the load testing tool.
Date	Date of the test run.
Start Time	The start time of the selected run configuration.
Duration	The total time used by the selected run.
	Scenario Elapsed time. Enables you to select a start and end time range for displaying data in the Summary page. For details, see Set duration filter.
Maximum Running Vusers	The maximum number of Vusers that ran concurrently in the selected test run. This metric indicates the capacity of the test.
Errors	The total number of errors in the selected run. A large number of errors during a specific time period can indicate a performance problem with the application.
	Additional filters. Opens the filter panel for defining filter criteria for the data that is displayed in the Summary page. For details, see Set filter for displaying data.

Back to top

Results pane

The results pane provides the following results for the run.

Element	Description
Transactions	Transactions measure the performance of the server. Each transaction measures the time it takes for the server to respond to specified Vuser requests that you define in your script. The following transaction information is displayed: Failed: The total number of transactions that failed. Passed: The total number of transactions that passed. Passed transaction ratio: A widget displaying the ratio of transactions that passed during the selected test run. Transactions per second: The average and total number of transactions per second during the selected test run.
Hits per sec	The average and total number of hits (HTTP requests to a web server) per second, over the selected test run.
Throughput	The average and total throughput over the selected test run. Throughput is the amount of data received from the servers, measured in megabytes. The average throughput is the total amount of data received from the servers in megabytes divided by the duration of the run in seconds.

Back to top

Transactions grid

The Transactions grid displays data about the transactions in the test run.

The following transaction response time information is included.

Item	Description
Transactions (<number>)	The total number of unique transactions in the test run.
Transaction Name	The name of the measurement.
Minimum	The minimum time it took for the transaction to complete.
Average	The average time it took for a transaction to complete.
Maximum	The maximum time it took for a transaction to complete.
Median	The median transaction response time.
Std. deviation	The standard deviation for the transaction response time.
90th percentile	The response time of 90% of the transactions. In other words, 90% of transactions fall within this amount of time. To set a different percentile, click the dropdown button and select from the menu.
Passed	The number of transactions that passed for each measurement.
Failed	The number of transactions that failed for each measurement.
Stopped	The number of transactions that stopped for each measurement.
Total	The number of transactions for each measurement.
Favorites	Transactions that have been added to favorites are indicated with a Favorites icon . Transactions marked as favorites are displayed at the top of the grid unless the grid is sorted, grouped, or a filter has been applied. For details, see Personalize the transactions grid.

Back to top

Personalize the transactions grid

You can personalize the transactions grid by sorting, grouping, filtering, and selecting the columns you want to see.

Action	Description
Select Columns	Click the Available columns button and select which of the columns you want to display in the transactions grid. Drag the columns to rearrange the display order.
Search	To search for transactions by name, click the Search button and type the name, or part of it, in the Search field. All transactions that contain the search string are displayed. Clear the search string to restore the full list of transactions.
Sort	You can sort the grid according to the values of any column by clicking the column header. Click the column again to reverse the sort order. To remove the sort order, right-click the column header and select Clear Sorting.
Add red line to TRT	To better identify problematic transactions, you can define an upper limit (red line) in seconds for the transaction rate. Click the Add red line to TRT button . Select either average in seconds or 90th percentile for the transaction rate. Define a value in seconds and click Apply. A red line is displayed above all transactions where the selected parameter is less than the configured value. Transactions above the line are those that exceed the defined upper limit.
Export grid	Click the Export grid button to export the transactions grid. The grid can be exported as: a CSV file. an image file.
Add favorites	Favorites help you to quickly see the transactions you are most interested in monitoring. Select a transaction and click the Add to Favorite button on the right side of the transactions grid. When a transaction is added as a favorite, it is indicated by the Favorites icon . By default, the transactions grid is sorted by favorites. You can select up to 10 transactions to add to your Favorites. You may need to remove some of your Favorites before you can add more. When you add transactions to your Favorites, these transactions are shown at the top of the transactions grid. To remove a transaction from your Favorites, click its row so that the Favorites icon no longer appears.

Your customized settings are automatically saved when you log out, and restored the next time you log back in. Settings are saved for each test run.

Back to top

Set duration filter

You can set a filter for the Run Summary, specifying the start and end time range.

To set a time range for the summary page:

1. In the Run Summary, click the Scenario elapsed time button . The time range filter panel is displayed.

2. Select a specific time frame to display in the Running Vusers graph area. This shows the behavior of Vusers over time (ramp up, steady time, and ramp down).

   The time frame for which results are displayed is shown at the top of the graph. You can change the time range using one of these options:

   • Manually change the start and end time counters located above the graph.

   • Place the cursor in the graph area and drag it to select a time range.

     

3. Click Apply to save the selected time range filter conditions. When a time range filter is active, this is indicated by an active filter notification dot on the duration filter icon .

Back to top

Set filter for displaying data

You can set a filter specifying the type of data to be displayed in the Summary page only.

To set options for filtering the data:

1. In the Run Summary page, click the Additional filters button . The data filter panel is displayed.

2. Select criteria and values for each filter condition that you want to use.

   Filter by	Description
   Transaction name	The name of the transaction.
   Transaction end status	The end status of a transaction: Passed, Failed, Stopped.
   Group name	The name of the group to filter by.
   Script name	The name of the script.
   Vuser IDs	The IDs of the Vusers you want the data to display, separated by commas. To specify a range of Vusers, enter the beginning and end of the range you want to display. Example: 5,7, 10-45.
   Host name	The name of the Host machine. Select one or more hosts from the list.
   Think Time	Think Time options: Don't include or Include. By default, think time is turned off and the transaction time displayed shows pure time.

3. Click Apply to save the selected filter conditions. When a filter is set, this is indicated by an active filter notification dot on the Filter button .

   To clear the filter, click Clear Filter. All the information you entered in the filter is deleted.
   

Back to top

View metrics

To further analyze the run, you can also view metrics for the selected run. For details, see View the dashboard.

Back to top