Share this page
After you design tests in the Test Plan module, you organize test execution by creating test sets in the Test Lab module. A test set contains a subset of the tests in your project designed to achieve specific test goals.
ALM supports different types of test sets. The following table describes each test set type:
|
Test Set Type |
Description |
|---|---|
| Performance |
For running unattended remote performance tests. You can add only performance tests to this test set. You arrange for a performance test to be executed from the server by scheduling a timeslot. A timeslot contains a test set, the details of the remote hosts on which the test set will run, and a time and duration for running the test set. For more details about how to run a Performance test, see Run tests in ALM. For more details on timeslots, see Reserving Timeslots Overview. ALM Editions: Performance test execution is available only for ALM Edition and LoadRunner Enterprise. For information about ALM editions and their functionality, see ALM Editions. To find out what edition of ALM you are using, ask your ALM site administrator. |
| Default |
For running client-side, locally controlled and launched functional tests. You can add both manual and automated functional tests to this test set. You can arrange for default tests to be run in an ad hoc manner. For more details on how to run default test sets, see Run tests in ALM. |
| Functional |
For running server-side, unattended functional tests.You can add only automated functional tests to this test set. You arrange for a functional test set to be executed from the server by scheduling a timeslot. A timeslot contains a test set, the details of the testing hosts on which the test set runs, and a time and duration for running the test set. For more details about how to run a Functional test set, see Run tests in ALM Build verification suites are a key component in ALM's Continuous Delivery solution. They facilitate an automated, end-to-end deployment and testing framework that makes application development more efficient, reliable, and quick. For details about how build verification suites can be used as part of this process, see Deploying and Testing your Application in ALM. For more details on timeslots, see Reserving Timeslots Overview. ALM Editions: Functional test sets available only for ALM Edition. For information about ALM editions and their functionality, see ALM Editions. To find out what edition of ALM you are using, ask your ALM site administrator. |
| External |
Contains external type tests (EXTERNAL-TEST |
). External type test sets are read-only. You cannot create, modify, or run test sets directly from ALM. For more details on external testing, see When defining a test set, ALM adds instances of your selected tests to the test set. Each test instance contains a defined test configuration. A test configuration enables you to run the same test under different scenarios. For more details on test configurations, see Test Configuration Overview.
A test sets tree enables you to organize your application management process by grouping test sets in folders and organizing them in different hierarchical levels.
To decide which test sets to create, consider the goals you defined at the beginning of the application management process. Consider issues such as the current state of the application, and the addition or modification of new features.
Example:
Here are examples of general categories of test sets you can create:
|
Test Set |
Description |
|---|---|
|
Sanity |
Checks the entire application at a basic level—focusing on breadth, rather than depth—to verify that the application is functional and stable. This set includes fundamental tests that contain positive checks, validating that the application is functioning properly. For example, in the Mercury Tours application, you could test whether the application opens, and enables you to log in. |
|
Regression |
Tests the system in a more in-depth manner than a sanity set. This set can include both positive and negative checks. Negative tests attempt to fail an application to demonstrate that the application is not functioning properly. |
|
Advanced |
Tests both breadth and depth. This set covers the entire application, and also tests the application's advanced options. You can run this set when there is ample time for testing. |
|
Function |
Tests a subsystem of an application. This could be a single feature or a group of features. For example, in the Mercury Tours application, a function set could test all activities related to booking a flight. |
After you have created test sets, you assign test set folders to cycles defined in the releases tree in the Releases module. A cycle represents a development and QA cycle based on the project timeline.
You assign remote hosts to functional or performance test instances in a test set. For details, see Testing Hosts Overview.
For details on working with test sets, see How to Create Test Sets.
