Create and schedule a test suite

In the Tests tab, add tests to a test suite and then plan the suite's run schedule.

Create a test suite

Add tests to a test suite.

To create a suite:

  1. Open the Tests tab. Here you see details of all of the tests in your workspace.

  2. Click Add <test type> and select tests to add them to a test suite. For details, see Create test suites.

  3. When creating the test suite, in the Test execution configuration area, define the following fields:

    Field Description
    Machine template

    Select the AMI (Amazon Machine Image) where the suite will be executed.

    This describes a particular machine template, specifying the testing tool, browser type and available RAM to execute the test suite.
    Run mode

    Specify whether to run tests in the suite one after the other, or in parallel.

    The default run mode is Serial, which runs tests one after the other. Serial tests don't necessarily run according to their order in the test suite.

  4. In the test suite planning tab, the Execution Status field indicates whether a particular test can currently be run on the cloud. The following statuses are available:

    Status Description
    Ready The test type and test runner are both appropriate for cloud execution, and the Run mode parameter is set to Automatic.
    Unavailable The test type is not appropriate for cloud execution.
    Not ready The test type is appropriate for cloud execution but the test runner is not. If you want to run this test on the cloud, configure a test runner. For details, see Enable cloud execution.

  5. The Test suite > Schedules tab shows all schedules assigned to a test suite.

    • In the Schedules tab, click Add Existing Schedules and assign one or more schedules to the test suite.

    • After schedules are assigned to a suite, you can select them and click Remove Schedules to remove one or more schedules from the test suite.

  6. In the Tests tab, you can use the toolbar buttons to plan and run test suites. For details, see Plan and run test suites.

Back to top

Create schedules

Use the Schedules tab to create schedules based on your operational needs, such as hourly, daily, and run once. You can then assign test suites to one or more schedules for test execution. For example, you might have a suite run nightly, weekly, and also run once for regression testing.

To create a schedule:

  1. In the Schedules tab, click Add schedule and define the schedule details.

    A schedule's status is Inactive as long as it is under construction.

  2. You can assign a release and milestone to the schedule.

    Note that this is only relevant for filtering and trends. The schedule continues to run even after the release or milestone's end date.

  3. In the Time scheduling section, define the Run mode which sets whether the schedule should run once, or if it is recurring.

    • If you choose to run the schedule once, specify the start time.

    • If you choose recurring, specify the start time, end time (optional), and interval.

      Tip: You can run a schedule once and see that it runs successfully, then edit the schedule and make it recurring.

  4. After creating a schedule, add tests suites. Click on the schedule ID link to drill down to its details. In the schedule's Test Suites tab, click Add Existing Test Suites to assign the schedule to one or more test suites.

    If a schedule is set to run immediately, it is delayed for three minutes to enable you to add test suites before running.

    Note: Tests are run serially or in parallel based on the Run mode field.

  5. Within each schedule, the Schedule Runs tab shows the 5 upcoming runs of the schedule, and their run history.

  6. To duplicate a scheduled run, select a run and choose More > Duplicate Schedule Run. Enter a start time for the new schedule.

Back to top

See also: