Limitations

This topic lists limitations for the current version of StormRunner Load.

Load tests

The following table lists limitations for load tests.

Limitation Description Limitation
Number of concurrent tests
  • You can run one test at a time with a trial license.
  • When you purchase a license through the online store, by default you are limited to a maximum of five concurrent test runs.
Network emulation

Network emulation is supported for the following protocols:

  • SAP Web
  • TruClient Firefox
  • TruClient IE
  • Web/HTTP
  • Web Services
Network emulation

Network emulation is not supported in the following script types:

  • Gatling
  • Java
  • JMeter
  • LeanFT
  • Selenium
  • TruApi
  • TruWeb
Enable multiple IP addresses Network emulation is not supported when this feature is enabled.
Wininet
  • Network emulation is not supported when this feature is enabled.
  • Scripts in which WinInet is enabled do not support multiple IP addresses.
Private cloud

The following script types are supported:

  • Web HTTP/HTML

  • TruAPI

  • SAP Web

  • JMeter HTTP

  • Gatling

  • Oracle NCA

  • Oracle Web

Azure locations

You cannot use Azure locations for:

  • A tenant configured with whitelisted IP addresses for scheduler and result servers.
  • A test that enables multiple IP addresses from a load generator in the cloud.
AWS locations
  • The Sao Paolo AWS region is not supported.
  • For the Beijing AWS region, script size is limited to a maximum of 80 MB.

Back to top

Agents

The following table lists limitations for agents.

Limitation Description Limitation
Federated users StormRunner Load on-premises agents (such as load generators, private cloud, Git agents, and monitors) do not support federated users.

Back to top

Monitors

The following table lists limitations for monitors.

Limitation Description Limitation
Monitor types You can only add one monitor type to a test definition.
SiteScope on- premises
  • If you select or clear the Disable integration check box in the SiteScope configuration, but the agent continues to behave as it did before you made the change, restart the SiteScope service.
  • If a monitor that you did not select appears in the monitor gallery, stop the load test, and reset the SiteScope agent and the SiteScope service.
SiteScope on-premises Docker integration Standard application monitors deployed during runtime are not supported.
Dynatrace dashboards Dynatrace dashboards designed with rich clients are supported, however, dashboards designed with Web clients are not supported.
AppDynamics metrics

When using an AppDynamics monitor in a load test, AppDynamics metrics are shown with a delay of approximately two minutes. This means that a load test that runs for less than three minutes may not display any AppDynamics metrics.

Back to top

Scripts

The following table lists limitations for scripts.

Limitation Description Limitation
LoadRunner scripts Scripts created with versions prior to LoadRunner 12.0 are not supported.
LoadRunner cross Vuser transactions Not supported.
LoadRunner rendezvous points
  • Rendezvous points are supported with default policy and timeout. These parameters will be configurable in future releases.
  • You cannot dynamically change the load of scripts that contain rendezvous points.
  • Advanced scheduling is disabled for scripts that contain rendezvous points.

LoadRunner mobile protocols Support for Mobile Application-HTTP/HTML, TruClient Native Mobile, TruClient Mobile Web.
Web HTTP/HTML Snapshots Not supported.
Wininet Network emulation is not supported when this feature is enabled.
Maximum script size 200 MB
TruClient scripts
  • Script is stopped if it hangs for more than 10 minutes.
  • TruClient scripts can run with emulation on Firefox or Internet Explorer only.
TruClient Script Converter Supported for Windows only
TruClient script created with Firefox .xpi Not supported.
TruClient Native Mobile scripts StormRunner Load does not support Native Mobile scripts recorded in TruClient version 12.53.
Localized support StormRunner Load supports scripts written in non-Latin alphabets. However, you still must use Latin characters for file and folder names.
Additional Vusers Adding additional Vusers is not supported if the test uses network virutualization.
Network Virtualization Network Virtualization is not supported for Web scripts recorded using WinINet.
64-bit Replay 64-bit Replay of LoadRunner scripts is not supported.

Back to top

Runtime settings (RTS)

The following table lists limitations for runtime settings.

Limitation Description Limitation
Proxy settings

If your script is configured to run with proxy settings that are inaccessible from outside your local network, StormRunner Load may ignore RTS settings. Disable the proxy settings and run the test again.

If the issue persists, open a support case.

Back to top

Single user performance data

The following table lists limitations for single user performance data.

Limitation Description Limitation

Number of scripts

  • NV Insights report. You can specify one script per test.
  • TRT breakdown. You can specify up to five scripts per test.

Script type

Only Web HTTP/HTML, TruClient Mobile Web, TruClient IE, TruClient Chrome, and TruClient Firefox scripts are supported.

Your script is configured to run with proxy settings that are inaccessible from outside your local network

TRT breakdown widgets and the NV Insights report will not generate.

Disable the proxy and run the test again.

If the issue persists, open a support ticket.

NV Insights report limitations
  • The network scenario is displayed as default scenario.
  • Total throughput per transaction is not supported.
WebPage Test report Generating a WebPage Test report will add additional time (10 to 20 minutes after the last running Vuser is stopped) to your test run.

Back to top

Reports

The following table lists limitations for reports.

Limitation Description Limitation
Add Notes Text formatted in italics displays as regular font in the PDF.
Number of transactions Reports support up to 2000 transactions. If you have more than 2000 transactions, you may encounter performance issues in the Reports UI or in the Export to PDF or Word functionality.
Custom report
  • You can add a maximum of 5 snapshots per report.
  • If your test has more than 1000 transactions, a large scale test, a snapshot cannot contain more than 200 data rows.
  • If your test has fewer than 1000 transactions, a snapshot cannot contain more than 600 data rows.

Back to top

Dashboard

The following table lists limitations for the dashboard.

Limitation Description Limitation
Widgets
  • For best performance, do not display more than 8- 10 widgets on the dashboard at one time.
  • If the number of metrics in a widget exceeds 300, results are displayed in table view only.
  • If the number of metrics in a widget exceeds 1000, only 1000 results are displayed.
Snapshot on error
  • The number of snapshots generated per test is limited to 20.
  • For each unique error id, only one snapshot is generated.
Data latency In rare cases, results returned after a few minutes might be updated to a previous data point during the test run.

Back to top