VisualAgentBench
Evaluation framework spanning visual GUI, embodied, and design tasks, including mobile and WebArena-based environments.
跨平台网页Android相关研究
评测
已审阅并标注「评测」的研究与资产。
条目依据已审阅标签归类，同一主题不表示资源之间存在依赖关系。日期保留来源精度，注释保留原语言。
Web Context Bench (Python)
Local-page benchmark comparing six browser representations on token use, factual reading and target-element selection, with deterministic answer scoring.
网页
WebClick
A web-interface localization benchmark with screenshot instructions and target boxes, including agent browsing, human browsing and calendar cases.
网页
WebGames
150 client-side web challenges in five capability domains, built to be easy for humans but hard for browsing agents, each revealing a password when solved.
网页
WebGuard
Codebase, annotation toolkit, and action-level risk dataset for training and evaluating guardrail models that flag unsafe browser-agent actions before execution.
网页
WebRewardBench
An offline preference-evaluation set for web process reward models, pairing page and trajectory context with preferred and rejected candidate decisions.
网页
WebTailBench
Live-web task definitions and rubrics for evaluating computer-use agents, with preserved original tasks, a refreshed V2 task suite and a separate refusal set.
网页
WebTestBench
An end-to-end web-testing benchmark where agents derive test checklists from development instructions, interact with deployed applications and report functional or constraint-related defects.
网页
Windows Agent Arena
Windows 11 benchmark for multimodal desktop agents in a reproducible VM that runs locally or in parallel on Azure ML, with a harder mode where agents must set tasks up themselves.
Windows桌面
WindowsAgentArena-V2
Windows benchmark revision with task/evaluator fixes and VM-initialization support, documented alongside PC-Agent-E.
桌面Windows
WONDERBREAD
An offline benchmark of workflow documentation, quality assessment and knowledge transfer using human web-navigation demonstrations, action traces and written procedures.
网页
WorldGUI
611 desktop GUI tasks that agents must complete from varied starting points, shipped with instructional videos and project files, plus the self-reflective WorldGUI-Agent baseline.
桌面
GUI-R1 data bundle
Training and evaluation Parquet bundles accompanying GUI-R1, including GUI grounding and mobile/web action-prediction data.
桌面WindowsLinuxmacOSAndroid网页
ScienceBoard evaluation trajectories
Archives of ScienceBoard agent evaluation runs, separated by agent configuration and screenshot, accessibility-tree or set-of-marks observation mode.
桌面Linux
ScreenDrag
GUI dragging data with screen observations, prior state, and continuous pointer actions, provided as trajectory files and Parquet representations.
桌面
ScreenSpot-Pro data
High-resolution professional interface screenshots and target annotations for evaluating instruction-based GUI localization.
桌面WindowsmacOSLinux
UI-AGILE-Data
UI-AGILE training annotations and screenshots together with converted GUI-grounding and AndroidControl evaluation files.
Android
UIBert AppSim and RefExp annotations
Two Rico-derived UI component retrieval datasets: AppSim pairs semantically similar elements across screens, while RefExp links referring expressions to target elements.
Android
UICrit
Mobile-interface critiques and quality ratings with region coordinates and RICO screen references, including a larger three-annotator release than the original paper dataset.
WebPRM Collection preference data
Checklist-annotated web decision records with page observations, prior actions, one preferred continuation and rejected alternatives for process-reward learning.
网页
WebJudge 7B
A visual trajectory judge that retains selected intermediate screenshots to evaluate whether a web agent completed its task.
网页
AdvAgent (formerly AdvWeb)
Research code for constructing and evaluating adversarial inputs to web agents, with a black-box red-team pipeline using Mind2Web data and SeeAct.
网页
AgentStudio
Toolkit and Ubuntu-based environment for building and evaluating generalist computer-use agents through GUI and API interaction.
桌面Linux
AndroTMem inference and evaluation code
A public Android GUI evaluation framework with action-history, summary and anchored-memory prompt modes, plus step-action and dependency-aware task scoring.
Android
AUITestAgent
Generates mobile GUI interactions from natural-language test requirements and checks application behavior against those requirements.
Cua
Monorepo behind Cua Spaces, which gives agents full macOS or Linux desktops, plus Cua Driver for operating native apps, Lume for Apple Silicon VMs, Cua Bench and the CUA-S1 decision models.
桌面
D-PoT evaluation code
Offline prompting and evaluation code for Dynamic Planning of Thoughts on Android-in-the-Wild, including action extraction and comparison with reference actions.
Android
DroidCall generation and evaluation code
Data-generation, fine-tuning and evaluation utilities for teaching small language models to invoke Android intents through predefined functions.
Android相关研究
GUI Grounding Evaluation Harness
ScreenSpot-Pro evaluation harness with explicit coordinate transforms, prompt and crop-based inference comparisons, and per-sample grounding accuracy and cost records.
HUD
SDK for RL environments and evals spanning coding, browser, computer-use and robotics agents, whose environments expose SSH, MCP, CDP or VNC capabilities behind a minimal start-and-grade protocol.
网页桌面
LearnAct
Released inference and evaluation code for demonstration-conditioned mobile GUI agents on LearnGUI-Offline. The repository describes a multi-agent adaptation method and links the LearnGUI demonstrations.
MemGUI-Agent
MemGUI-Agent training and offline evaluation tools provide trajectory conversion, LoRA SFT templates, and step-level checks of GUI actions, memory updates and context folding.
Android
Mobile Env
AndroidEnv-based platform for building GUI agent benchmarks and training agents, where task definition files emit instructions, rewards and episode ends from screen text, view hierarchy or log events.
Android
MobileForge
Android GUI-agent adaptation framework combining app exploration, generated curricula and rollout feedback with hint-conditioned step-level GRPO; the documented public training path targets Qwen3-VL-8B.
Android
Mobster engine
iOS agent engine organized around an observe, decide, verify and act loop, using WebDriverAgent screen state and phone actions such as taps, typing, swipes and app switches.
iOS
OpenMobile-2 code
Evaluation adapters and training guidance for OpenMobile-2 across Android emulators and browser-rendered mobile simulation.
Android网页
ORBIT framework
Inspect-based multi-agent evaluation framework with role, scheduling and communication controls, BrowserART accessibility-tree actions, and desktop mouse, keyboard and screenshot tools.
网页桌面
RedTeamCUA
A controlled testing framework that combines desktop virtual machines and replicated websites to evaluate computer-use agents against indirect prompt injection.
网页桌面
ScienceBoard VMware environment
A prebuilt Ubuntu virtual-machine archive containing the software environment used for ScienceBoard scientific computer-use tasks.
Linux桌面
ScreenSuite
A shared evaluation harness for GUI-model perception, offline action prediction and multi-step interaction, using simple smolagents-based agents across existing benchmarks.
网页Android桌面
SheetCopilot
Spreadsheet automation agent for Windows/Excel, with benchmark assets and a separately released headless Ubuntu evaluation backend.
桌面WindowsLinux
STEVE / STEVE-R1 research code
Research code and linked models for step-verified computer-use training; the current repository describes STEVE-R1 and its trajectory releases.
桌面WindowsLinux
TAG attention-driven GUI grounding
Grounding and evaluation code that aggregates a pretrained vision-language model’s attention maps to localize requested interface elements without fine-tuning.
网页
UI Defect Mocker
Synthesizes visual UI defects from mobile screenshots and Android layout metadata to support GUI-testing experiments.
Android
VideoCAD training and evaluation code
VideoCADFormer training, action-log preprocessing and evaluation code for learning CAD interface action sequences from screen recordings of browser-based Onshape.
网页
Web-Shepherd inference and evaluation
Process-reward inference and benchmark-evaluation utilities that use task checklists to assess individual web-agent decisions.
网页
WebAgent-R1
Environment setup, multi-turn reinforcement-learning and evaluation tooling for browser agents interacting with WebArena.
网页
第 661–720 条，共 723 条资源。
通过主题导出清单获取完整记录和证据。克隆目录后，可将主题记录直接交给标准 RAG 与引用导出工具。