Using Image Mode

Control Behavior

Action

Actions that can be performed on a web based application. Available options are:

·       Wait Until Exists- Waits till the image is found on the web page and is in focus. You can use this to avoid any delay that might occur for the image to appear. This interaction returns a Boolean value of true if the image is found and false if the image is not found. The Boolean value can be set to a variable and checked in a conditional statement to perform an appropriate action after finding the image.

·       Wait Until Disappears- Waits until the image disappears from the web page. You can use this to avoid delay that might occur for the image to disappear. This interaction returns a Boolean value of true if the image is not found and false if it is found. The Boolean value can be set to a variable and checked in a conditional statement to perform an appropriate action after finding the image.

·      Wait Until Clicked- Waits until the image is clicked. This interaction returns a Boolean value of true if the image is clicked and false if the image is not clicked. The Boolean value can be set to a variable and checked in a conditional statement to perform an appropriate action after finding the image.

·      Click And Type- Allows to left click at the required area and provide the input value. Set a default value or pass the value using parameter defined in the Parameter bar.

·      Left Click- Performs a left click specified at the offset point.

·      Right Click- Performs a right click at the specified offset point.

·      Left Double Click- Performs a left double click at the specified offset point.

·      Right Double Click- Performs a right double click at the specified  offset point.

·      Mouse Over- Moves mouse pointer over the area at the specified  offset point.

·      Drag- Moves the draggable image based upon the mentioned vertical and horizontal coordinates.

·      Horizontal Scroll- Searches for the image towards either right or left direction based on the speed of the scroll as per the option selected in the Scroll Direction and Scroll Action fields respectively.

·      Vertical Scroll- Searches for the image in the upward or downward direction based on the speed of the scroll as per the option selected in the Scroll Direction and Scroll Action fields respectively.

·       Get Text- Extracts text from the selected image.

·       Type Text- Allows entering the text where the cursor is present on the page. Set a default value or pass the value using parameter defined in the Parameter bar.

·       Press Keys- Performs press action for the specified key. Apply modifiers like Control, Shift, Alt before the key press as specified in the fields Modifier One and Modifier Two.

·       Key Down- Performs press of a single key specified on the keyboard.

·       Key Up- Brings the pressed key back to normal position. It must be performed after the Key Down action to release the pressed key.

Interaction

The corresponding interaction set against the selected action.

Appears if Action selected is Wait Until Exists or Wait Until Disappears.

Timeout (ms)

 The wait time for the plugin until image is found or identified that it does not exists.

Poll Frequency (ms)

The frequency of checking the availability of the image and if the system is ready for the next action.

Appears if Action selected is Click And Type or Type Text.

Input Source

The input value that must be entered. You must define a parameter in the Parameter bar to use this option.

Select the check box beside Input Source and enter the value, if you want to set a default value.

Appears if Action selected is Type Text.

Delay In Characters (ms)

Triggers the delay when there is typing lag from the keyboard.

Appears if Action selected is Drag.

Drag X

The vertical drag performed on the application window to drag the draggable image. The value must be entered in pixels.

Drag Y

The horizontal drag performed on the application window to drag the draggable image. The value must be entered in pixels.

Appears if Action selected is Horizontal Scroll or Vertical Scroll.

Scroll Amount

The scroll speed (set in pixels) for each movement while searching for the image in the specified scrollable area.

Scroll Direction

The direction of scroll for searching the image.

Available options for Horizontal Scroll are Left and Right and for Vertical Scrolls are Up and Down.

Appears if Action selected is Press Keys, Key Down or Key up.

Key

The single key set as input from the keyboard.

Appears if Action selected is Press Keys.

Modifier One

Select the first modifier to create the key combination. Available options are - Control, Shift, Alt and Win (Windows) keys of the keyboard.

Modifier Two

Select the second modifier to create the key combination .Available options are- Control, Shift, Alt and Win (Windows) keys of the keyboard.

Field Properties

Variable Name

User defined name of the variable that stores the captured value. This field appears only for some of the selected actions.

Display Name

User specified display name of the action  configured.

Variable Type

Type of the variable defined. This field appears only for some of the selected actions.

Appears if Action selected is Get Text.

This field is applicable only for AssistEdge Engage application.

Is C-View

If selected, the field configuration captured in Automation Studio is visible in the Engage C-View tab.

Misc

Focus Required

Signifies if the Focus Window activity needs to be added before the interaction that gets created in Automation Studio from the multimodal interface. It is typically used if the configurations are done on multiple windows and the intended window needs to be in focus for image automation to work.  

By default, this field is cleared.

OCR Properties

This section appears only when Action selected is Get Text. This section is applicable only for text extracting functionality.

Modes

The mode to capture the image for text extraction. Available options are:

·       Fixed- When the image is captured in this mode, the coordinates of the selected area are stored to extract the text and not the image.

·       Reference- When the image is captured in this mode, two different areas are captured. The first image captured is stored as a reference or a template, while the second image captured stores the coordinates from where the text is extracted.

By default, Fixed mode is set. You can change the mode as per the requirement.

Note: Once you change the mode, you need to capture the image again using the (Recapture) button to extract the text.

Engine

The OCR engine used for text extraction. By default, the in built OCR engine is Tesseract. You can change the value in the Application activity. Refer Text Extractor activity to know more.