AI Object Detection Feedback Tool

Mobile, web, and windows-based SAP GUI tests

When using AI to inspect your application for objects, you can send anonymous feedback to OpenText to help improve the identification in the future.

Overview

Using the feedback tool, you can comment on how well AI Object Inspection identified the objects in your application.

Comments that you send to the feedback server are anonymous. These are considered when the AI object identification capabilities are upgraded, and help build a better engine over time.

Note: If you need help with object identification in your application, save your feedback locally, and attach it to a support ticket.

Using this tool, you can provide various types of feedback: 

  • General comments

  • Comment on the classes chosen for identified objects

  • Mark objects that were not identified at all

Back to top

Open the AI Object Detection feedback tool

When inspecting the objects in your application using AI, after the object identification is completed, click How is the detection? Help us improve.

The AI Object Detection feedback tool opens, displaying your application and highlighting the objects detected by AI.

Back to top

Register and log in to the feedback server

Before you can send any feedback, you must register and log in to the feedback server. Register to the server once, and use the credentials you set up to log in each time you open the AI Object Detection feedback tool.

Configure proxy settings

If your system requires using a proxy to access the Internet, configure your proxy settings before registering.

  1. Click the Settings button . In the Settings dialog box, expand Proxy settings.

  2. Select one of the following options:

    • System Proxy: The AI Object Detection feedback tool automatically obtains your system's proxy settings.

    • Manual Proxy: Enter your proxy address and credentials.

Ignore certificate errors

By default, UFT One employs Full SSL (Strict). However, you can click the Settings button and select Ignore certificate errors to ignore certificate errors.

Register to the feedback server

Click the REGISTER button, provide your contact details and follow the instructions to complete the registration.

Note: If you try to register with a user name that was already registered, the registration fails.

Log in to the feedback server

To log in, click the LOG IN button and provide the credentials you set up when you registered.

Back to top

Enter your feedback

After you log in to the feedback server, you can send OpenText feedback about the identification. Your feedback does not affect the current object identification in your application. It will be considered in future releases of AI-based testing as OpenText continues to expand and enhance these capabilities.

You can provide various types of feedback:

Feedback Type Enter your feedback
General comment

Click to expand the right-hand pane and enter your comments in the input box.
Approve or reject the identification of a specific object's type

Hover over an identified object. You can see the object class and associated text.

Give a thumbs up or thumbs down .
Comment on the identification of a specific object When you give a thumbs down , enter a comment in the box that opens.
Mark additional objects that were not identified
  1. Click Mark an object .

  2. Move and resize the highlighted grid to fit the object that you want to mark.

  3. Enter an object type and press Enter. The object type can be one of the types supported by AI-based testing or a suggestion for a new type. See AI-based testing: Supported control types.

To remove an object from the list of objects you marked, click the object in the application and then click the delete icon.

Blur sensitive data

If your application displays sensitive data that you do not want to include in the feedback that you send, you can blur it using the AI Object Detection feedback tool:

  1. Click the Pixelate button.

  2. Drag and resize the highlighted area to cover the information you want to blur.

  3. Click .
  4. Repeat as necessary to blur additional areas.

Back to top

Save a local feedback file (optional)

If you need help with object identification in your application, save your feedback locally, and attach it to a support ticket.

To save your feedback

  1. Enter at least one element of feedback.

    Note: Saving your feedback does not require you to register or login.

  2. Click SAVE to save your feedback as a zip file on your computer.

    A dialog box opens, displaying the file path for saving your feedback.

    Tip: Copy and save this location for convenience or future use.

After saving your feedback, you can click the exit button to close the AI Object Detection feedback tool.

Back to top

Send your feedback

Feedback sent to the feedback server is anonymous, and not used to analyze customer issues. If you need help with object identification in your application, save your feedback locally, and attach it to a support ticket.

To send your feedback to OpenText:

  1. Make sure you are logged in to the feedback server.

  2. Enter at least one element of feedback.
  3. Select whether to include metadata in your feedback (application and device details).

  4. Click SEND FEEDBACK.

    Note: On some smaller screens, the SEND FEEDBACK button is hidden.

Details on metadata collected with your feedback

When you agree to include metadata in your feedback, the following information is sent to OpenText:

OpenText software information
  • AI context: Mobile or Non-Mobile
  • The AI-based testing software version
  • The OCR software version
Application information
  • For a mobile application: The mobile device's model, OS type, OS version, mobile app name.
  • For a web application: The browser type, the web page address (URL)

Back to top

See also: