AUITestAgent
Generates mobile GUI interactions from natural-language test requirements and checks application behavior against those requirements.
自动化
已审阅并标注「自动化」的研究与资产。
条目依据已审阅标签归类，同一主题不表示资源之间存在依赖关系。日期保留来源精度，注释保留原语言。
COLA demo
Research demonstration of collaborative Windows GUI automation with dynamic task scheduling and recovery mechanisms.
桌面Windows
GUI-HARVEST
Optimizes GUI-agent execution code from repeated rollout evidence and checks proposed changes against fixed validation gates.
桌面
Lumen browser agent
A screenshot-driven browser agent over Chrome DevTools Protocol, with resumable sessions, context compression, action replay and configurable completion checks.
网页
Mobile Harness
Portable agent instructions and integration tooling for local or cloud phone control through mobilerun-core.
AndroidiOS
Mobile Next MCP
An MCP server exposing mobile accessibility snapshots, screenshots and device interactions across real devices, simulators and emulators.
AndroidiOS
Nanobrowser
A browser-extension agent that reads pages, interacts with elements and moves between tabs from a side-panel task interface.
网页
OculiX (SikuliX continuation)
A maintained continuation of SikuliX that locates on-screen targets with image matching and OCR, drives desktop or Android interfaces, and exposes scripting and optional MCP interfaces.
桌面WindowsmacOSLinuxAndroid
OpenAgents Web Agent
The OpenAgents browser-control component, connecting a Chrome extension to a web agent and local chat platform for navigating sites and completing interface tasks.
网页
PC-Agent-E training and deployment
Tools for refining and augmenting human computer-use trajectories, preparing supervised training data, and deploying a native PC-Agent-E scaffold.
桌面WindowsLinux
Playwright MCP
MCP server that lets LLM clients drive Playwright browsers through structured accessibility snapshots instead of screenshots, with opt-in vision, PDF and devtools capabilities.
网页
PyAutoGUI
Cross-platform Python module for scripted mouse and keyboard control, message boxes and screenshots with on-screen image search, working on the primary monitor under Windows, macOS and Linux.
桌面相关研究
ShowUI-Aloha
Desktop agent that records demonstrations, derives semantic action traces, and uses them to plan and execute related workflows.
桌面WindowsmacOS
Sikuli legacy research implementation
The original Sikuli source distribution combines screenshot targets with a Jython scripting library and IDE for visual GUI automation and testing.
桌面macOSLinuxWindows
STEVE / STEVE-R1 research code
Research code and linked models for step-verified computer-use training; the current repository describes STEVE-R1 and its trajectory releases.
桌面WindowsLinux
Universe legacy GUI interaction client
An archived Gym-compatible client that exposes screen observations and keyboard/mouse actions over VNC for remote application and browser environments, including the historical World of Bits integration.
网页桌面相关研究
Windows-MCP
A Windows MCP bridge exposing application, window, keyboard and mouse operations plus native UI-state inspection for agents.
Windows桌面网页
第 121–141 条，共 141 条资源。
通过主题导出清单获取完整记录和证据。克隆目录后，可将主题记录直接交给标准 RAG 与引用导出工具。