AI Object Detection Pane (Options Dialog Box > GUI Testing Tab)

GUI mobile, web, and windows-based SAP GUI tests

This topic describes the global AI-based testing abilities that you can configure in the AI Object Detection pane in UFT One.

Access the AI Object Detection pane

UFT One version 2023:	Select Tools > Options > GUI Testing tab > AI Object Detection node.
UFT One version 2022 and earlier:	Select Tools > Options > GUI Testing tab > AI node.

Configure general AI-based testing settings

The AI Object Detection > General pane provides options for you to configure general AI-based testing settings.

Enable/Disable UFT One's AI features

UFT One's AI features is enabled by default. You can clear the AI active option to disable AI features.

Changes you make in the AI active option take effect only after you restart UFT One.

Runtime object identification

Fine-tune object identification settings to optimally identify objects in your application in runtime.

Object identification settings
Automatic scrolling	Select this option to enable automatic scrolling. When running a test, if an object is not displayed in the application but the application screen is scrollable, UFT One automatically scrolls further in search of the object. UFT One scrolls similarly when running a checkpoint that requires that an object not be displayed in the application. Default: Selected. You can customize the direction and extent of the scrolling: Scrolling direction: The direction in which to scroll. Default: Down. Max number of scrolls: The maximum number of pages or screens to scroll. Default: 2. Tip: To temporarily override these global settings in a test run, add AI run settings steps to your test. For details, see the AIRunSettings Object in the UFT One Object Model Reference for GUI Testing.
Enable caching for object identification	By default, UFT One uses a caching mechanism for AI object identification during test runs, to improve performance. You can clear this option to disable the caching mechanism if you don’t find it useful in your case.
Enable verifying identification	Select this option to enable verifying object identification during a test run. When running a test, UFT One verifies the object identification before performing the operation. You can enable or disable verification for mobile contexts, non-mobile contexts, or both. Note that the added verification affects the speed of the test run. Default: Enabled for non-mobile contexts only. Tip: To temporarily override the global settings in a test run, add AI run settings steps to your test. For details, see the AIRunSettings Object in the UFT One Object Model Reference for GUI Testing.

Object identification settings

Automatic scrolling

Select this option to enable automatic scrolling. When running a test, if an object is not displayed in the application but the application screen is scrollable, UFT One automatically scrolls further in search of the object.

UFT One scrolls similarly when running a checkpoint that requires that an object not be displayed in the application.

Default: Selected.

You can customize the direction and extent of the scrolling:

Scrolling direction: The direction in which to scroll. Default: Down.
Max number of scrolls: The maximum number of pages or screens to scroll. Default: 2.

Tip: To temporarily override these global settings in a test run, add AI run settings steps to your test. For details, see the AIRunSettings Object in the UFT One Object Model Reference for GUI Testing.

Enable caching for object identification

By default, UFT One uses a caching mechanism for AI object identification during test runs, to improve performance.

You can clear this option to disable the caching mechanism if you don’t find it useful in your case.

Enable verifying identification

Select this option to enable verifying object identification during a test run. When running a test, UFT One verifies the object identification before performing the operation.

You can enable or disable verification for mobile contexts, non-mobile contexts, or both.

Note that the added verification affects the speed of the test run.

Default: Enabled for non-mobile contexts only.

Tip: To temporarily override the global settings in a test run, add AI run settings steps to your test. For details, see the AIRunSettings Object in the UFT One Object Model Reference for GUI Testing.

AI Transformation Assistant

The Replace run results with AI object suggestions option enables you to replace existing steps with AI object steps to create a more resilient and platform-agnostic test.

When this option is selected, your test run results do not reflect the results of the test. Instead, the report suggests an AI object and operation for any step where a property-based test object can be replaced with an AI object.

This option is not selected by default.

Configure OCR settings

In the AI Object Detection > OCR pane, specify which OCR settings to use:

UFT OCR settings. AI features use the OCR engine, languages, and settings defined in the Text Recognition pane. For details, see Text Recognition Pane (Options Dialog Box > GUI Testing Tab).
Default AI OCR. AI features use the languages you select below, and a different OCR engine than the one selected in the Text Recognition pane.

OCR languages

This is relevant when the Use the default AI OCR option is selected.

OCR languages are used when identifying text in the application, when using text to identify a specific object, and when retrieving text from the application.

Move languages from the Available Languages list to the Selected Languages list, to specify the languages to use for AI-based text recognition.
Select languages in the Selected Languages list and click Move Up or Move Down to prioritize languages.

Supported languages: Afrikaans, Arabic, Basque, Bulgarian, Catalan, Chinese, Traditional Chinese, Croatian, Czech, Danish, Deutsch, Dutch, English, Esperanto, Estonian, Finnish, French, Greek, Hebrew, Hungarian, Icelandic, Italian, Irish, Japanese, Korean, Latin, Latvian, Lithuanian, Macedonian, Maltese, Norwegian, Polish, Portuguese, Romanian, Russian, Serbian, Slovenian, Slovak, Spanish, Swedish, Turkish, Ukrainian, Welsh

Configure the remote AIOD service connection

UFT One 2023:	In the AI Object Detection > Service pane, configure UFT One's connection to the remote AI Object-Detection (AIOD) service.
UFT One 2021-2022:	In the AI > Service pane, configure UFT One's connection to the remote AI service. This service is now referred to as the remote AIOD service.

Define connection information.

Use remote service	Select to use the AI Object-Detection service you installed on a remote machine. For details, see Use the remote AI Object-Detection service.
Remote AI server details	Enter the IP address and port number for accessing the remote AIOD service. IP address: The IP address of the machine on which you installed the remote AIOD service. Note: If the remote machine is in a domain, you can specify a hostname instead of the IP address. If the remote machine is in a workgroup, you must use the IP address. Port number: The port number you defined during the service installation. The value ranges from 0 to 65535.
Ignore certificate errors	Select to ignore certificate errors. UFT One version 2021 R1 and earlier: The remote AIOD service uses a self-signed certificate to secure its communication with UFT One. To prevent certificate errors, you must select this option. UFT One version 2022 and later: If you are using a CA certificate, you do not have to select this option.
Use proxy settings	Select to connect using a proxy. Proxy type. Defines the type of proxy to use when connecting to the remote server: System proxy HTTP proxy Proxy address. The proxy IP address and port. If System proxy is selected, this field is populated automatically, and is read-only. Specify authentication. Select to enter proxy credentials. Proxy user name and password. The proxy credentials used to connect to the remote server, if Specify authentication is selected.

Click Test connection to make sure the configuration is correct.

The connection with the remote AIOD service is set up as soon as you save your changes in this pane.

UFT One version 2021:

Configuration includes only IP address and port number.

Test connection button is not available. Feedback about connection success is provided only when remote AIOD service is consumed.

Configure the AIOD Cloud Service connection

Note: The AIOD Cloud Service is available as a Technical Preview upon request. It is not available in UFT One out of the box. To learn more, contact your account team and send an email to AIODCloudService@opentext.com.

UFT One 2023:	In the AI Object Detection > Service pane, configure UFT One's connection to the AIOD Cloud Service.
UFT One 2022:	In the AI > Service pane, configure UFT One's connection to the AIOD Cloud Service.

Define connection information.

Use cloud service

UFT One 2022: Use Micro Focus SaaS

Select to use the AIOD Cloud Service.

See Use the AI Object-Detection Cloud Service.

Access key

Enter the access key you received to connect to AIOD Cloud Service.

Use proxy settings

Select to connect using a proxy.

Proxy type. Defines the type of proxy to use when connecting to the remote server:

System proxy
HTTP proxy

Proxy address. The proxy IP address and port. If System proxy is selected, this field is populated automatically, and is read-only.

Specify authentication. Select to enter proxy credentials.

Proxy user name and password. The proxy credentials used to connect to the cloud, if Specify authentication is selected.

Click Test connection to make sure the configuration is correct.

The connection with the AIOD Cloud Service is set up as soon as you save your changes in this pane.

AI > Model

UFT One versions 2021 R1 and earlier:

The AI Model Update feature is currently unavailable. There is no need to use this pane.

Restore defaults

The Restore Factory Defaults button resets all Options dialog box options to their defaults.