SCREEN Click image on screen function

The SCREEN Click image on screen function in RPA.

Help CentreBuilding Processes

This article describes the RPA Screen functionality to click on an image on the screen.

For a full list of available functions, please read SCREEN functions.


Description

The SCREEN Click image on screen function finds an image on the screen and clicks on it. You can configure the click type, button, and offset from the image center.


Setting it up

To use the SCREEN Click image on screen function, follow these instructions:

{{popups:rpas/add:action=screen-click}}

Once on a process map:

  1. Navigate to the process where you would like to add the SCREEN Click image on screen function
  2. Click on the green button's drop-down (right side of the green button labelled "Process")
  3. On the menu that appears, click on the "+ Activity" item
  4. From here you can select the SCREEN Click image on screen option
  5. Click "Add" once you are done

Input parameters

ParameterRequiredTypeDefaultDescription
Image pathYesText-The file path to the reference image to find and click
ConfidenceNoNumber (0.0-1.0)0.9The minimum confidence threshold for a match
RegionNoArray [x, y, w, h]-Restrict the search to a specific screen region
ClicksNoNumber1The number of clicks to perform
ButtonNoSelect (left, right, middle)leftThe mouse button to use for clicking
Offset XNoNumber0Horizontal offset from the image center in pixels
Offset YNoNumber0Vertical offset from the image center in pixels
VariableNoTextlocationThe variable name to store the location of the clicked image

Output variables

The {location} variable contains an object with properties: x, y, width, height, center_x, center_y of the found image.


Errors

ErrorDescription
Image not found on screenThe specified image could not be found on the screen
Image file not foundThe specified image file path does not exist

Tips

  • Use the offset parameters to click relative to the image center, for example to click a button next to a label
  • Set clicks to 2 for a double-click action

Related functions

See it working on your own data

Everything documented here ships with the platform – try the document tools free, or go live in 7 days.