Beyond Pass or Fail: Multi-Dimensional Benchmarking of Foundation Models for Goal-based Mobile UI Navigation

Sphinx benchmarks foundation models on goal-based mobile UI navigation, using app test cases and a toolkit that identifies different failure modes.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

What is this resource?

Resource type

Research paper

Topics

Evaluation, Mobile navigation, Industry

Record publication date

2025-01-06

Evidence retrieved

2026-11-05

Resource ID

arxiv:2501.02863

Recorded paper version

arXiv v2

Version updated: 2025-02-11T13:34:12Z.

This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.

Authors

Dezhi Ran, Mengzhou Wu, Hao Yu, Yuetong Li, Jun Ren, Yuan Cao, Xia Zeng, Haochuan Lu, Zexin Xu, Mengqian Xu, Ting Su, Liangchao Yao, Ting Xiong, Wei Yang, Yuetang Deng, Assaf Marron, David Harel, Tao Xie

Cite this paper

Download BibTeX · Download CSL JSON

Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.

Explore related topics

Scope and limitations

The annotation and scope were reviewed against the complete retained arXiv abstract (v2). The abstract names mobile apps but no mobile operating system. Experiments, reported performance and artifact availability have not been independently reproduced.

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

1. arxiv api

   Retrieved 2026-11-05T21:13:41Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.

   Content fingerprint

   4f8c52402475481097941fac66a689892def7057d6129b23f62f53f31e53690a
2. editorial primary review

   Retrieved 2026-11-05T23:01:30Z. Supports: name, kind, summary, environments, topics, scope, relations.

   Content fingerprint

   07ba687f5a4948ae3e83cb632bcef71297cf230f7c82d773b26dbec826a63e91

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.

Useful? Star Awesome CUA on GitHub