Manage automation tests

This topic describes how to create, manage and edit your automation tests in SRF.

Tab: AUTOMATION

Find your tests and test details

The AUTOMATION tab displays all tests stored in SRF, including both uploaded tests, and tests you've created entirely in the cloud.

Filter

On the left side of the AUTOMATION tab, click a filter toggle to enable or disable it.

Then define the filter you want to use to display your tests.

Search

At the top of the grid, click the search icon to search for:

  • A string from your test name.
  • Your test ID.
View

View details about your tests in the grid, such as last modified dates and run success trends.

For details about a specific test run:

  1. Click your test.

  2. On the right, click the LATEST TEST RUNS tab.

  3. To zoom in further, click a specific test result.

    For more details, see Run SRF tests and analyze results.

Back to top

Create/edit automation tests in SRF

Create automation tests directly in SRF by combining modular scripts and defining your test environment.

Create your test

On the AUTOMATION tab, click NEW, and then select one of the following:

Mobile Apps Test

Tests your mobile apps on mobile devices.

Web Test

Tests your websites on desktop or mobile browsers.

Define your test details

On the right, define your test's name, a description, and other details about your test.

Tags

In your test details on the right, click and then enter text to add a tag.

Tip: Filtering by tags helps locate tests and test results across SRF.

Tags also enable you to run batch tests as part of a continuous delivery process. For details, see SRF and Jenkins.

Scripts

In your test details on the right, click the SCRIPTS tab to add scripts to your test.

ADD SCRIPT

Add a script already saved in your SRF assets.

These might be scripts previously recorded in SRF, or uploaded from an external testing tool.

RECORD

Record a script without leaving SRF.

Your script is stored in your SRF assets and can be used again in another test. For more details, see Record scripts.

Script parameter runtime values

To run a parametrized script, first add parameters to your script and set default values on the SCRIPTS tab. For details, see Manage your script parameters.

Then, on the AUTOMATION tab, modify runtime parameter values as follows:

  1. In the test details on the right, click SCRIPTS to view the scripts in your test.

  2. For each script that has a parameter, click the down arrow on the right to display the parameters.

  3. Click in the parameter value field to change it, and then click outside the field to save the value.

Environment

In your test details on the right, click the ENVIRONMENTS tab to define the environments on which you want to run your test.

To delete an item, hover over the row and click the Options bar on the right. Then, click Delete to delete the session. To clear all selections, click Clear.

Define your environment using the options displayed, depending on your test type:

Web tests

Click one of the following:

  • Browser Lab opens SRF's full browser lab. There, add both desktop and mobile browsers, based on operating system type and version.
  • Add Android Rule | Add iOS Rule. If you are running Web tests on mobile devices, add capability rules to enable SRF to find devices for you.

Tunneling: If you are testing an app installed behind a corporate firewall, select a configured tunnel to use when accessing that app. This option is available after selecting browser options.

For more details, see Manage tunnels.

Mobile tests

Do one of the following:

Select a specific device from the mobile lab.

Then, in the ENVIRONMENT SELECTION dialog box, click items to add them to your environment.

| Add capability rules to enable SRF to find devices for you.

SRF supports multiple rules for Android devices, or iOS devices, but not for both types simultaneously.

For more details, see Tips for mobile testing.

Back to top

Tips for mobile testing

Use the following options when selecting mobile devices and apps:

Search and filter

Use the search bar to filter the apps or devices displayed.

Add rules to find matching devices.

If you are working with mobile devices and can be flexible with the exact device used, click ADD RULE to run your session on any available matching device in your lab.

Define additional app settings.

After adding apps to your environment, define your app settings:

  • Hover over the UPLOAD value to select an app upload version.
  • Toggle on the PACKAGED option to use the packaged version of the app.

Define the app you want to use to start your test or session

In the START SESSION FROM area, select the system app you want to use to start, and any of the following options as applicable:

  • Restart the app when the test/session starts
  • Install the app at the beginning of the test/session
  • Uninstall the app when the test/session ends

Back to top

See also: