Use Azure DevOps Server or Services to trigger a local test

This topic describes how to trigger a UFT One test stored on your local machine from Azure DevOps Server (formerly known as TFS).

Note: This topic describes working with UFT One Azure DevOps extension version 3.*. To benefit from the latest functionality, we recommend updating existing tasks' versions to 3.*. When using this extension version, make sure that you installed the corresponding UFT.zip file from the ADM-TFS-Extension GitHub repository.

Run a test saved on your local machine

In Azure DevOps Server, do the following:

  1. Create a pipeline. (Note: If you are using TFS, skip this step)

    1. Create a build pipeline or a release pipeline, with the Empty job template.

      Note: A build pipeline is the pipeline type created when you do not explicitly create a release pipeline.

    2. Select the agent pool that includes the agent on which you want to run your tests.

    3. In the pipeline variables, add a UFT_LAUNCHER variable. The variable's value should be the full path to the UFTWorking folder.

    For more details, see the Microsoft Azure documentation.

  2. Add a UFT One task and place the step in the correct place in the build order.

    Note: If you are working with a release pipeline, add the task in the relevant stage, then place the step in the build.

    1. From the Task catalog, select the Test tab. A list of all available test tasks is displayed.

    2. From the Test tab, select the UFT One File System Run task and click Add. A new, empty task is added as part of your build pipeline.

      Note: If you are working with a release pipeline, the task is added as part of your deployment process.

  3. Provide the following information for your build step.

    Description

    By default, the Azure DevOps Server CI system uses a preset descriptor for the task. Click the Rename button and provide a more meaningful name for your step.

    Tests The test, test batch file, or folder containing the tests to run. For multiple tests, the test path, name, or test result path should be separated by a comma.
    Timeout

    The amount of time (in seconds) to wait if there is a problem opening or running a test. If the field is left blank, there is no timeout.

    Generate 'Failed Tests' report

    Select whether to generate a report which provides information on your tests' failed steps. After the run, the report is available in the Extensions tab.

  4. (Optional) Configure the run step to upload UFT One's test result information to an Azure Storage location

    Uploading the UFT One results to Azure Storage lets you to access the results from the Azure DevOps portal after the test run.

    Make sure you performed the steps described in Set up Azure Storage for your UFT One test results.

    Then enter the following options in your Run From File System build step:

    Do you want to upload the UFT report to the storage account?

    Select Yes.

    Artifacts to upload

    Select whether to upload only the html run results report, an archive of all the UFT One result files, or both.

    Note: When running an API test we recommend uploading the archive, as the standalone html run results report does not contain any information on the captured data. The content for RequestBody and HttpRawRequest steps is available in the html file contained in the archive.

    Report file name

    Accept the default file name, which is based on the pipeline name and build number, or enter a name of your choice.

  5. Configure the CI system control options for the step, including:

    Enabled Specify whether the step should be run as part of this build.
    Continue on error Instructs the CI system to stop or continue the build if there is an error on this step.
    Always run Instructs the CI system to always run this step.
  6. Set your pipeline to run: 

    Build pipeline: Save and queue the pipeline.

    Release pipeline: Create a release and deploy the pipeline.

    When the pipeline runs, the UFT One tests run as part of the task you added.

Back to top

View the test results

After the test run, you can view the run results in the following ways:

A visual report

In the Extensions tab of the run results, you can see a report including the following parts: 

  • The UFT Report section shows the test run status, as well as links to the UFT One report and archive, if they were uploaded to Azure Storage.

  • The Run Summary shows the number of tests that ran, the percentage of each status and so on.

  • If you selected the Generate ‘Failed Tests’ report option, the Failed Tests section shows a detailed breakdown of any failed steps.

Note: If you are working with a release pipeline, these results are available on the Stage level.

Retrieve run result files

  • The detailed failure results are stored in JUnit format in the junitreport.xml file located in the UFTWorking/res/Report_<build run number> folder.

  • If the UFT One html report and the archive file were uploaded to Azure Storage, you can access these in the storage container.

If you run your UFT One tests from Team Foundation Server (TFS)

You can also view UFT One run results in the Summary tab of the TFS build run results.

For example:

Back to top

See also: