Perform exploratory testing with Network Virtualization

This section describes how to do exploratory testing to check your app's behavior on mobile devices with Network Virtualization.

Network Virtualization test modes

After you see Set up Network Virtualization integration in Mobile Center, you can proceed to test your app.

First, decide which mode you would like to use. You can work in Interactive or Transactions mode.

Transactions mode

Interactive mode lets you simulate a true mobile environment:

  • Test your app’s performance over different network conditions, such as 3G or 4G.
  • Change the network conditions in the middle of an operation.
  • Emulate temporary network disconnection.
  • Verify that the app recovers from a network disconnection that occurs during different operations.

Transactions mode lets you mark one or more actions as transactions. You perform the same transactions over different mobile networks. At the conclusion of your test, you can view the NV Insights report that shows a comparison of your app's response times over the different networks and provides performance optimization recommendations.

Start the exploratory test

Once you decide on a testing mode, you can begin your testing. See Best practices for Network Virtualization testing for useful guidelines.

  1. In Mobile Center's Devices tab, click the Play button on the device to open the remote view. Wait for the Control Panel in the left pane to load. For details, see Device control panel.
  2. Click the NV button in the simulations panel. The Network Virtualization window opens.

    Tip: Click the Collapse and Expand buttons to open and close this window.

  3. Click Start Emulation. The Network Virtualization window opens, displaying your device's proxy information.

  4. Click Download on Device to open the certificate in your device's default browser. You can also manually copy the URL of the certificate into your device's browser. Accept the installation of the certificate on your device.

    Note: For Android devices, you will be prompted to provide a name for the certificate. You can provide any name for this certificate.

  5. Configure your device to use the NV proxy.

    For more information, click the How To button in this window.

  6. After you have configured the device's proxy click Next.

Perform actions in your app

  1. In the Network Virtualization window, select an emulation mode, Interactive or Transactions, as described in Network Virtualization test modes.

  2. For Interactive mode, perform actions on your app whose performance your want to test. First, select No emulation to create a baseline for comparison, as described in Best practices for Network Virtualization testing. After you create a baseline, resume the interactive testing.

  3. For Transactions mode, create a baseline as described in Best practices for Network Virtualization testing. Mark and perform the transactions. For example, for a Launch app transaction:

    1. In the Transaction name field, enter the name of the transaction (or select it from the list if you already performed it in this test).
    2. Click Start Transaction and click the app on the device to launch it.
    3. When the app finishes loading, click Stop Transaction.
    4. Repeat steps a-c for additional transactions.
    5. Change the network profile and repeat this procedure.
  4. To stop the emulation, click the Stop button at the top of the Network Virtualization window.
  5. In the Emulation Ended window, click Download report or Download HAR to download the analysis results. You can use the HAR (HTTP Archive) file to create a test in StormRunner Load or in LoadRunner.

  6. Restore the proxy settings on your devices.

Back to top

Restore the proxy settings

After you complete the exploratory test on your mobile device, restore the device's original proxy settings. If you are using on-premises Network Virtualization and are planning to run additional tests with Network Virtualization on this device, you may prefer not to remove the proxy configuration at this point.

Back to top

Best practices for Network Virtualization testing

Before performing your network emulations, you should create a baseline against which to measure your mobile emulations.

You do this by setting the emulation to No emulation in the Network Virtualization window. This mode allows the transfer of traffic through the NV Test Manager server, without applying any emulation. The subsequent emulations that you perform will be compared to the baseline. In the report, you will be able to see the effect of the different mobile networks on your app.

For Interactive mode, perform actions with No emulation to create a baseline. Then, interact in the following ways:

  • Select a single mobile network and perform the same operations as before.
  • Emulate many mobile networks, repeating the same actions on each of the networks.
  • Emulate a broken connection for apps that require Internet. Enter a number in seconds and click Disconnect. This blocks all of the traffic from the NV Test Manager server. The title bar of the Network Virtualization window indicates that the device is disconnected. When it reconnects, check that your app was able to recover.

For Transactions mode:

  1. Set the mobile network to No emulation to create a baseline.
  2. Click Start Transaction.
  3. Perform an action, for example a login, or the loading of a web page, that you want to measure.
  4. Click End Transaction.
  5. Change the mobile network to a value other than No emulation, and select an existing transaction name.
  6. Use the Start and End Transaction buttons to create another transaction using this new network, repeating the same actions as in the baseline transaction. By doing this, NV will be able to generate a comparison report of the transaction response times for each of your actions, per mobile network.

Back to top

Considerations and Known Issues

  • Network Virtualization exploratory testing using Transactions mode, is not supported for Internet Explorer 11.
  • The following considerations apply when using the NV on Cloud service:

    • If you begin in Interactive mode and switch to Transactions mode before ending your test, the data from the Interactive mode will not be included in the report.
    • If you perform a test in Transactions mode, you cannot return to Interactive mode. Close the session and restart it.
    • If you begin a test and remain idle for an extended amount of time, the connection to the NV on Cloud service will be terminated. Close the session and restart it.
    • The NV on Cloud service is only available when performing exploratory testing from the Mobile Center Lab console, but not from testing tools, such as UFT or TruClient.

Back to top

Next steps: