Analysis Summary Report

The Analysis Summary report provides general information about the execution of the load test scenario. It lists statistics about the scenario run and provides links to the following graphs: Running Vusers, Throughput, Hits Per Second, HTTP Responses per Second, Transaction Summary, and Average Transaction Response Time.

To access

Session Explorer > Reports > Summary Report

Important information

The Summary report for Diagnostics provides a usage chart that links to and displays each individual transaction's Web, application, and database layers, and provides the total usage time for each transaction.

Relevant tasks

You can save the Summary reports to an Excel file by selecting View > Export Summary to Excel or by clicking on the toolbar.

Summary Report with No SLA

User interface elements are described below:

UI Element

Description

Scenario Details

Shows the basic details of the load test scenario being analyzed.

Statistics Summary

This section shows a breakdown of the transaction statistics and also provides links to the following:

Transaction Summary

This section displays a table containing the load test scenario's diagnostics data. Included in this data is a percentile column (x Percent). This column indicates the maximum response time for that percentage of transactions performed during the run. All transaction response times are calculated based on "passed" transactions data.

Note: You can change the value in the percentile column in one of the following ways:

  • Open the Options dialog box (Tools > Options). Click the General tab and in the Summary Report section enter the desired percentile in the Transaction Percentile box.

  • Select View > Summary Filter or click on the toolbar. The Analysis Summary Filter dialog box opens. In the Additional Settings area enter desired percentile.

HTTP Responses Summary

This section shows the number of HTTP status codes returned from the Web server during the load test scenario, grouped by status code.

Note: There are additional Diagnostics sections that may appear at the end of the Summary report, depending on the configuration of your system.

Back to top

Summary Report with SLA

User interface elements are described below:

UI Element

Description

Scenario details

This section shows the basic details of the load test scenario being analyzed.

Statistics Summary

This section shows a breakdown of the transaction statistics.

X Worst Transactions

The X Worst Transactions table shows the worst transactions in terms of how often the transactions exceeded the SLA boundary during the run, and by how much.

Note: You choose how many transactions are displayed in this table in the Summary Report section on the General tab of the options dialog box. Open the dialog box (Tools > Options) and enter the number of transactions to display. The default is 5.

You expand a transaction to get more information. When expanded, the following information appears for each transaction:

    • Failure Ratio. The percentage of time intervals where the transaction exceeded the SLA. You can see this graphically in the Scenario Behavior Over Time section below.

    • Failure Value. The average percentage by which the transaction exceeded the SLA over the whole run.

    • Avg exceeding ratio. The average percentage by which the transaction exceeded the SLA over a specific time interval.

      For example, say in one time interval the figure is 4.25%. This means that during that time interval, the transaction may have exceeded the SLA boundary several times, each time by a different percentage margin, the average percentage being 4.25%.

    • Max exceeding ratio. The highest percentage by which the transaction exceeded the SLA over a specific time interval.

      For example, using the same time interval as above, the transaction may have exceeded the SLA several times, each time by a different percentage margin. The highest percentage being 7.39%

    Analysis allows you to analyze a specific transaction in more detail. You open the Analyze Transaction tool from this section by clicking the Analyze Transaction button. For more information on Transaction Analysis Reports, see Analyze Transactions Dialog Box.

Scenario Behavior Over Time

This section shows how each transaction performed in terms of the SLA over time intervals. The green squares show time intervals where the transaction performed within the SLA boundary. Red squares show time intervals where the transaction failed and gray squares show where no relevant SLA was defined. Click here to see an example of the scenario behavior over time section of the summary report.

Note: The time intervals displayed in the Scenario Behavior Over Time section may vary for each interval. The time interval set in the tracking period of the SLA is only the minimum time interval that will be displayed.

It is only the display that varies. The SLA is still determined over the time interval you choose in the Advanced Settings section.

Analysis allows you to analyze a specific transaction in more detail. You open the Analyze Transaction tool from the Scenario Behavior Over Time section in one of the following ways:

  • Select the transaction to analyze from the list and enter the time interval in the From and To boxes. Then click Analyze Transaction.
  • Drag the mouse over the desired transaction and time range to analyze. Then click Analyze Transaction.

For more information on Transaction Analysis Reports, see Analyze Transactions Dialog Box.

Transaction Summary

This section displays a table containing the load test scenario's diagnostics data. Included in this data is a percentile column (x Percent). This column indicates the maximum response time for that percentage of transactions performed during the run. All transaction response times are calculated based on "passed" transactions data.

Note: You can change the value in the percentile column in the Summary Report section of the General tab of the Options dialog box. Open the dialog box (Tools > Options) and enter the desired percentage.

Alternatively, you can also change the value in the Summary Filter (View > Summary Filter) .

HTTP Responses Summary

This section shows the number of HTTP status codes returned from the Web server during the load test scenario, grouped by status code.

Note: There are additional Diagnostics sections that may appear at the end of the Summary report, depending on the configuration of your system.

Back to top

Summary reports for Cross Result Graphs

User interface elements are described below:

UI Element

Description

<graphs>

Displays summary information for the scenarios that you are comparing. The information is displayed in a way that enables you to compare data from the different scenarios. Includes the same type of information as the regular Summary report except for the following:

  • SLA information

  • Diagnostics information

  • Scenario behavior over time

Back to top

See also: