Skip to main content
Desktop Automation is a capability exclusive to Profy Desktop — Expert can operate desktop applications just like you do: moving the mouse, clicking buttons, typing text, and reading screen content to help you automate repetitive work on the desktop.
Desktop Automation is only available in the Profy Desktop client and currently supports macOS. This capability is not available in the web version.

​
Core Capabilities

Mouse Control

Move the cursor, single-click, double-click, right-click, drag — Expert can precisely operate any visible element on the desktop.

Keyboard Input

Type text in any application, execute keyboard shortcuts, and switch input methods.

Screen Understanding

Expert can “see” your screen content, understand the interface layout and current state, and make operation decisions accordingly.

Cross-Application Coordination

Switch between multiple desktop applications — copy files from Finder to an email client, or extract data from a browser and paste it into a spreadsheet application.

​
How to Use

1

Open Profy Desktop

Make sure you’re using the Profy Desktop client (not the web version).
2

Describe the Task

Tell Expert in the conversation what you’d like to accomplish on the desktop. For example: “Open System Preferences, find the Display options, and change the resolution to default.”
3

Observe and Confirm

Expert will begin operating your desktop. You can watch the mouse movement and operation process in real time. If a step requires your confirmation, Expert will pause and ask.
4

Get Results

Once the task is complete, Expert will report the results in the conversation.

​
Typical Use Cases

Rename a batch of files, organize folders by rules, or batch-modify file properties — tell Expert the rules and it will execute them one by one.
Have Expert complete complex configuration changes in system settings or application preferences, saving you the time of navigating menus.
Extract data from one application, convert the format, and input it into another — for example, copying table data from a PDF reader to Excel.
Any mouse-and-keyboard operation sequence that you need to perform repeatedly can be delegated to Expert.
Unfamiliar with how a desktop application works? Have Expert demonstrate while explaining each step in the conversation.

​
Security

Desktop Automation runs within a secure sandbox environment with the following protections:
  • Sandbox Isolation: Expert’s operations are restricted by a system-level sandbox (Seatbelt), preventing access to sensitive system areas
  • Visible Operations: All operations are visible on your screen in real time, and you can interrupt at any point
  • Limited Permissions: Expert cannot access Keychain, password managers, or other security-sensitive areas

​
Recommendations

  • Keep the screen clean: Expert “sees” the screen to understand its targets — too many elements on the interface can increase recognition difficulty
  • Specify the target application: Tell Expert exactly which application to operate rather than letting it search
  • Close obstructing windows: Make sure the target application’s window is not blocked by other windows
  • Guide step by step: Break complex operation flows into step-by-step instructions and confirm each step before continuing

​
Browser Automation vs. Desktop Automation

These two capabilities complement each other — use Browser Automation for web-related tasks and Desktop Automation for local application operations.

​
Billing

Credit consumption for Desktop Automation primarily comes from model calls and screenshot analysis in the conversation. The operations themselves incur no additional charges.