# Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents

Agent Q combines guided tree search, self-critique and preference-based fine-tuning to train web agents from successful and unsuccessful interactions.

- Catalog URL: https://awesomecua.com/resources/arxiv-2408-07199/
- Original source: https://arxiv.org/abs/2408.07199
- Kind: paper
- Review: curated
- Scope: core
- Environments: web
- Topics: planning, self-reflection, imitation-learning, web-navigation
- Evidence checked: 2026-11-05T23:01:08Z
- ID: arxiv:2408.07199

## Limitations

The annotation and scope were reviewed against the complete retained arXiv abstract (v1). The abstract evaluates it in WebShop and booking scenarios. Experiments, reported performance and artifact availability have not been independently reproduced.

- Record JSON: https://awesomecua.com/resources/arxiv-2408-07199/record.json

## Authors

Pranav Putta, Edmund Mills, Naman Garg, Sumeet Motwani, Chelsea Finn, Divyansh Garg, Rafael Rafailov

## Citation exports

- BibTeX: https://awesomecua.com/resources/arxiv-2408-07199/citation.bib
- CSL JSON: https://awesomecua.com/resources/arxiv-2408-07199/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2408.07199v1
- First submission: 2024-08-13T20:52:13Z
- Version updated: 2024-08-13T20:52:13Z
- Abstract SHA-256: d7171ec4f2a16cb7c0416172e93b04197aac992ec0d324bfbc13ddae8253450c
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2406.12814%2C2406.13719%2C2406.14056%2C2406.14250%2C2406.14314%2C2406.18082%2C2406.19263%2C2407.00993%2C2407.01476%2C2407.01489%2C2407.01511%2C2407.01558%2C2407.03037%2C2407.03913%2C2407.04346%2C2407.05291%2C2407.07061%2C2407.08850%2C2407.09018%2C2407.09295%2C2407.10956%2C2407.13032%2C2407.13063%2C2407.15673%2C2407.15711%2C2407.16741%2C2407.17490%2C2407.18901%2C2407.19056%2C2407.20183%2C2408.00203%2C2408.02544%2C2408.06327%2C2408.07199%2C2408.11824%2C2408.15978%2C2409.02453%2C2409.04566%2C2409.07429%2C2409.08264%2C2409.09354%2C2409.10741%2C2409.11295%2C2409.13711%2C2409.14337%2C2409.14818%2C2409.15441%2C2409.15637%2C2409.17140%2C2409.20566&max_results=50 (retrieved 2026-10-16T06:31:32Z; SHA-256 b9a83994d8ac36ccdb606a5219511f8bb35ad3948ade4f9f3e28d386221aedfb)
- https://export.arxiv.org/api/query?id_list=2407.02117%2C2407.03502%2C2407.04363%2C2407.04856%2C2407.06048%2C2407.06886%2C2407.07061%2C2407.08898%2C2407.09025%2C2407.10788%2C2407.10839%2C2407.11691%2C2407.12821%2C2407.13063%2C2407.13696%2C2407.15325%2C2407.16741%2C2407.17789%2C2407.20143%2C2407.20183%2C2407.20727%2C2407.21075%2C2408.00545%2C2408.01025%2C2408.02248%2C2408.03326%2C2408.04168%2C2408.07199%2C2408.07720%2C2408.09071%2C2408.09559%2C2408.09577%2C2408.10215%2C2408.10605%2C2408.11551%2C2408.11791%2C2408.15769%2C2408.16119%2C2408.17035%2C2409.00088%2C2409.00138%2C2409.00608%2C2409.01710%2C2409.02453%2C2409.02689%2C2409.02813%2C2409.03215%2C2409.03402%2C2409.04465%2C2409.04566&max_results=50 (retrieved 2026-11-05T23:01:08Z; SHA-256 55e73483e758411be683956e70439cb009b0176bafb39a2e8c0e16796b9ce08e)