Cua
Monorepo behind Cua Spaces, which gives agents full macOS or Linux desktops, plus Cua Driver for operating native apps, Lume for Apple Silicon VMs, Cua Bench and the CUA-S1 decision models.
桌面
评测
已审阅并标注「评测」的研究与资产。
条目依据已审阅标签归类，同一主题不表示资源之间存在依赖关系。日期保留来源精度，注释保留原语言。
D-PoT evaluation code
Offline prompting and evaluation code for Dynamic Planning of Thoughts on Android-in-the-Wild, including action extraction and comparison with reference actions.
Android
DroidCall generation and evaluation code
Data-generation, fine-tuning and evaluation utilities for teaching small language models to invoke Android intents through predefined functions.
Android相关研究
GUI Grounding Evaluation Harness
ScreenSpot-Pro evaluation harness with explicit coordinate transforms, prompt and crop-based inference comparisons, and per-sample grounding accuracy and cost records.
HUD
SDK for RL environments and evals spanning coding, browser, computer-use and robotics agents, whose environments expose SSH, MCP, CDP or VNC capabilities behind a minimal start-and-grade protocol.
网页桌面
LearnAct
Released inference and evaluation code for demonstration-conditioned mobile GUI agents on LearnGUI-Offline. The repository describes a multi-agent adaptation method and links the LearnGUI demonstrations.
MemGUI-Agent
MemGUI-Agent training and offline evaluation tools provide trajectory conversion, LoRA SFT templates, and step-level checks of GUI actions, memory updates and context folding.
Android
Mobile Env
AndroidEnv-based platform for building GUI agent benchmarks and training agents, where task definition files emit instructions, rewards and episode ends from screen text, view hierarchy or log events.
Android
MobileForge
Android GUI-agent adaptation framework combining app exploration, generated curricula and rollout feedback with hint-conditioned step-level GRPO; the documented public training path targets Qwen3-VL-8B.
Android
Mobster engine
iOS agent engine organized around an observe, decide, verify and act loop, using WebDriverAgent screen state and phone actions such as taps, typing, swipes and app switches.
iOS
OpenMobile-2 code
Evaluation adapters and training guidance for OpenMobile-2 across Android emulators and browser-rendered mobile simulation.
Android网页
ORBIT framework
Inspect-based multi-agent evaluation framework with role, scheduling and communication controls, BrowserART accessibility-tree actions, and desktop mouse, keyboard and screenshot tools.
网页桌面
RedTeamCUA
A controlled testing framework that combines desktop virtual machines and replicated websites to evaluate computer-use agents against indirect prompt injection.
网页桌面
ScienceBoard VMware environment
A prebuilt Ubuntu virtual-machine archive containing the software environment used for ScienceBoard scientific computer-use tasks.
Linux桌面
ScreenSuite
A shared evaluation harness for GUI-model perception, offline action prediction and multi-step interaction, using simple smolagents-based agents across existing benchmarks.
网页Android桌面
SheetCopilot
Spreadsheet automation agent for Windows/Excel, with benchmark assets and a separately released headless Ubuntu evaluation backend.
桌面WindowsLinux
STEVE / STEVE-R1 research code
Research code and linked models for step-verified computer-use training; the current repository describes STEVE-R1 and its trajectory releases.
桌面WindowsLinux
TAG attention-driven GUI grounding
Grounding and evaluation code that aggregates a pretrained vision-language model’s attention maps to localize requested interface elements without fine-tuning.
网页
UI Defect Mocker
Synthesizes visual UI defects from mobile screenshots and Android layout metadata to support GUI-testing experiments.
Android
VideoCAD training and evaluation code
VideoCADFormer training, action-log preprocessing and evaluation code for learning CAD interface action sequences from screen recordings of browser-based Onshape.
网页
Web-Shepherd inference and evaluation
Process-reward inference and benchmark-evaluation utilities that use task checklists to assess individual web-agent decisions.
网页
WebAgent-R1
Environment setup, multi-turn reinforcement-learning and evaluation tooling for browser agents interacting with WebArena.
网页
WebLlama
Training, evaluation and integration tooling for dialogue-guided web agents, including Llama fine-tuning workflows and BrowserGym examples built around WebLINX.
网页
WebVLN research implementation
Training and evaluation code for question-guided website navigation that combines visual observations with web-specific HTML information.
网页
WinDOM code
GUI-grounding training and evaluation code with same-family distillation, GRPO recipes and point-in-box scoring, using a Windows-style web environment.
网页
第 781–805 条，共 805 条资源。
通过主题导出清单获取完整记录和证据。克隆目录后，可将主题记录直接交给标准 RAG 与引用导出工具。