How to Run Tests Automatically

This task describes how to run Default test sets automatically. To learn more about running tests automatically, see Automatic Test Execution Overview.

1. Prerequisites

   • Set up hosts for remote test execution. Before running tests automatically, you must set up host computers for the remote execution of automated tests, and assign testers for the execution of manual tests.

     Note: For important information about running UFT GUI tests, see How to Run UFT One GUI Tests.

   • Enable communication between ALM and the testing host. When running default test sets on remote hosts, ALM communicates directly with the testing host to initiate the test. Refer to the documentation for your required testing tool for more information about what ports must be opened and what other security settings must be adjusted to enable this communication.

   • Designate testers for running manual tests. When you run a manual test automatically and specify a remote host, ALM notifies a designated tester by email to run the test. This notification can be sent only if you have designated a tester for the test with a valid email address.

   To designate a tester, locate the test in the Execution Grid tab, and select a user in the Responsible Tester column.

2. Schedule and order test execution

   You can decide how and when tests are run using the following methods:

   • Scheduling. You can specify the date and time, and set conditions for executing your tests. For task details on scheduling Default test sets, see How to Schedule Test Runs.

   • Ordering. You can set the order in which you want your tests to be executed, using the Order Test Instances dialog box. Use one of the following:

     • In the Execution Flow, press the Ctrl key and select two or more tests. Right-click a test and select Order Test Instances.

     • In the Execution Grid, select Tests > Order Test Instances.

   For user interface details on the Order Test Instances dialog box, see Order Test Instances Dialog Box.

3. Run Default test sets automatically

   Run manual and automated default tests automatically on your machine using the Automatic Runner.

   In the Test Lab module > Test Sets tab, do one of the following:

   • Select a Default test set that includes one or more automated tests and click the Run Test Set button.

   • To run selected tests, select a Default test set and click the Execution Grid tab or Execution Flow tab. Select one or more automated tests and click the Run button.

   • To run only manual tests, select the tests and click the Run button. In the Manual Test Run dialog box, select Automatic Runner and click OK.

   To run the same test concurrently on multiple remote hosts, add multiple instances of the test to your test set. For user interface details on adding test instances to test sets, see Select Tests Pane.

   For user interface details on the Automatic Runner, see Automatic Runner Dialog Box.

4. Results

   For Default test sets, you can view details about the automatic test execution after execution is complete. In the Automatic Runner dialog box, select Run > View Execution Log. For user interface details, see Execution Log Dialog Box.

   After the test execution is complete, you can view a summary of test results in the following modules:

   • Test Lab. The updated status for each test run is displayed in the Execution Grid. Results for each test step appear in the Last Run Result pane. You can view more detailed results in the Test Instance Details dialog box.

   • Test Runs. The updated status for each test run in the project is displayed. You can generate reports based on test execution details.

   For more details on viewing test results, see View test runs.