ScreenHand

Tools · 15

• click Click a UI element using native Accessibility APIs (~50ms)
• type Type text into a UI element using native Accessibility APIs
• read_ui_tree Read the accessibility tree of the current application
• navigate_menu Navigate through application menus
• drag Drag a UI element to a target location
• scroll Scroll within a UI element or window
• browser_navigate Navigate to a URL in the browser via Chrome DevTools Protocol
• browser_click Click an element in the browser via CDP
• browser_type Type text into a browser element via CDP
• browser_run_javascript Execute JavaScript in the browser via CDP
• browser_fill_form Fill a form in the browser via CDP
• browser_stealth Perform browser actions with anti-detection measures
• browser_human_click Click with human-like behavior to avoid bot detection
• click_with_fallback Click using automatic fallback: Accessibility → CDP → OCR → coordinates
• type_with_fallback Type using automatic fallback: Accessibility → CDP → OCR → coordinates