AI-based testing: Supported control types

Mobile, web, and windows-based SAP GUI tests

This topic lists the control types that UFT One can recognize using Artificial Intelligence (AI).

Supported control types

Below is the list of control types that UFT One can identify using AI. The aliases defined for each class are alternative names that refer to the same controls. They are the keywords you can use for a control's type or class, when describing a control for a test step.

Class Aliases Examples Comments
bag shopping_bag  
bell alarm, notification  
button      
calendar (tech preview)    
camera    
categories    
chat    

chart

 graph

Supported only on:

  • UFT One 2022 and later

  • Mobile applications

check_box checkbox, togglable    

check_mark

 tick  

clock

 time

Supported only on:

  • UFT One 2022 and later

  • Mobile applications

close clear  

combo_box

 combobox, field  

contact card

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

copy

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

display

 Glasses

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

document

 File

Supported only on UFT One 2022 and later
dot_menu menu  
down_triangle collapse, down  

enter

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications
eq_settings settings  

exit

  

UFT One versions 2021 R1 and earlier: Supported on mobile applications only
facebook    
favorites rating, star  

filter

  

Supported on mobile applications only

find

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

folder

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

forward_to

 forward

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

  • UFT One version 2022: The class name is forward.
gear_settings settings  
hamburger_menu menu  
help    
home    
info    
input field, edit, editfield    

instagram

   Not supported on mobile applications
left_arrow left  
left_triangle left, back, previous  

linkedin

  

Not supported on mobile applications
location    

lock

  

Supported on mobile applications only
mail    

minus

 subtract, zoom_out  
pencil edit  

people

 group, team

Supported only on:

  • UFT One 2022 and later

  • Mobile applications

pin

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications
phone call  
plus

add

zoom_in

  
power    
printer print

Supported only on:

  • UFT One 2023 and later

  • Web applications

profile person, user  
radio_button radiobutton, togglable  

refresh

 reload, replace, sync

Supported only on:

  • UFT One 2022 and later

  • Mobile applications

right_arrow right  
right_triangle right, next, forward, play  

rss_feed

 rss

Not supported on mobile applications

save

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

schema

 Org Chart

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications
search    
share    
shopping_cart cart  

sort

  

Supported only on mobile applications

table (tech preview)

     Not supported on mobile applications
text      

text_box

includes multi-line text boxes

 textbox, field  
toggle_button toggle, switch, togglable  
tool_settings settings  
trash delete  
twitter    

up_arrow

 up Not supported on mobile applications

up_down

   Not supported on mobile applications

upload

  

Supported only on mobile applications

up_triangle up  
view    

window

  

  • Supported only on UFT One 2022 and later

  • Not supported on mobile applications

Youtube

   Not supported on mobile applications

Note:  

  • An underscore can be replaced with a space.

  • Use the text class only in AI Codeless Testing tests. In UFT One, identify text objects using the AIUtil.FindText or AIUtil.FindTextBlock methods.

  • Class names are case insensitive.

    UFT One version 2021 R1 only: Class names are case sensitive.

You can use general names to include multiple control types:

Generic name Used for Included controls
down down triangles down_triangle
field areas that accept text input, text_box, combo_box
left left pointers left_arrow, left_triangle
menu buttons that open a menu dot_menu, hamburger_menu
right right pointers right_arrow, right_triangle
toggleable, togglable Controls with changing states check_box, toggle_button, radio_button
up up pointers up_triangle, up_arrow

Calendar and table containers (tech preview)

In UFT One, as a tech preview, calendar and table controls can be used as container objects. Creating an object hierarchy helps create more resilient AI-based tests and increase test coverage.

When using AI object identification, if you choose to use calendar and table controls as containers, you can easily interact with the containers and the elements inside them. When you inspect or record a container control, UFT One displays the corresponding hierarchy of the control.

Note:  

  • Only table-like calendar controls are supported.

  • Table cell objects are identified using ABBYY OCR. UFT One versions 2021 R1 and later: To identify TableCell objects, you must have the ABBYY OCR Engine feature installed in UFT One.

For more details, see the AICalendar Object and AITable Object object reference in UFT One Object Model Reference for GUI Testing.

Back to top

Control types that can be identified by text

Controls of the following types can be more specifically identified by their text: 

  • button
  • check box
  • combo box
  • input
  • radio button
  • text box
  • toggle button

Back to top

Supporting Select operations on combo boxes

The combo box Select operation is a complex step. This section describes when UFT One supports running this operation.

Mobile testing: 

The Select operation is supported on a combo box identified by AI only if UFT One can also identify the combo box as a MobileDropDown.

Non-mobile testing:

UFT One first tries to identify the combo box as a WebList, as the Select operation is most efficient when using the object's native commands.

Otherwise, UFT One uses the AI capabilities to support the Select operation. In this case, the operation is affected by the AIRunSettings.ComboBoxSelect settings. These runtime settings tell UFT One how far and in which direction to scroll the combo box's list in search of the specified value.

The AI-based Select operation is supported on combo boxes with a simple drop-down list that opens by clicking the box.

Select is not supported on combo boxes that do not meet these conditions, for example: 

  • Combo boxes that open when hovered over

  • Combo boxes that open only by clicking the down arrow

  • Combo boxes with complex drop-down lists, such as lists with multiple columns, or list items displayed horizontally.

The Select action is supported on a combo box identified by AI only if UFT One can also identify the combo box as a WebList or a MobileDropDown.

Back to top

Feedback regarding supported control types

When using AI to inspect your application for objects, you can send feedback directly to Micro Focus. Using this tool, you can do the following:

  • Send anonymous feedback to the Micro Focus server.

    Comment on how well AI Inspection identified the objects in your application and help improve the identification in the future.

  • Save your feedback locally and attach it to a support ticket.

    If you need help with object identification in your application, open a support ticket and provide the details using the feedback tool.

See AI-based testing Feedback Tool.

Back to top

See also: