# AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generation

Introduces AutoScraper, a two-stage framework that uses HTML structure and similarities across pages to generate scrapers for data collection from websites.

- Catalog URL: https://awesomecua.com/resources/arxiv-2404-12753/
- Original source: https://arxiv.org/abs/2404.12753
- Kind: paper
- Review: curated
- Scope: adjacent
- Environments: web
- Topics: automation, data-generation, evaluation
- Evidence checked: 2026-11-05T23:00:57Z
- ID: arxiv:2404.12753

## Limitations

The annotation and scope were reviewed against the complete retained arXiv abstract (v2). Its task is generating web scrapers for data collection. Experiments, reported performance and artifact availability have not been independently reproduced.

- Record JSON: https://awesomecua.com/resources/arxiv-2404-12753/record.json

## Authors

Wenhao Huang, Zhouhong Gu, Chenghao Peng, Zhixu Li, Jiaqing Liang, Yanghua Xiao, Liqian Wen, Zulong Chen

## Citation exports

- BibTeX: https://awesomecua.com/resources/arxiv-2404-12753/citation.bib
- CSL JSON: https://awesomecua.com/resources/arxiv-2404-12753/citation.csl.json

## Recorded arXiv snapshot

- Version: 2
- Version source: https://arxiv.org/abs/2404.12753v2
- First submission: 2024-04-19T09:59:44Z
- Version updated: 2024-09-26T09:17:10Z
- Abstract SHA-256: 9197968c51e668d3737496aaebadaa324e2b20b182aad541cabb491e491d3b41
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22%29+AND+submittedDate%3A%5B200001010000+TO+202610160636%5D&start=800&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-16T06:36:58Z; SHA-256 c87e97eb397da04806d53145cf9c13be739fc657bb54dca9318c8c4ed2a36249)
- https://export.arxiv.org/api/query?id_list=2402.17834%2C2402.17896%2C2402.17930%2C2402.18450%2C2402.19114%2C2402.19446%2C2403.01024%2C2403.01248%2C2403.01877%2C2403.02502%2C2403.02757%2C2403.03636%2C2403.04692%2C2403.04957%2C2403.05278%2C2403.07548%2C2403.08295%2C2403.08978%2C2403.09333%2C2403.10249%2C2403.11481%2C2403.12037%2C2403.12881%2C2403.12968%2C2403.13257%2C2403.14508%2C2403.14720%2C2403.15049%2C2403.15203%2C2403.16971%2C2403.20271%2C2404.00282%2C2404.01131%2C2404.01226%2C2404.01318%2C2404.01477%2C2404.01549%2C2404.01744%2C2404.04902%2C2404.05427%2C2404.06395%2C2404.09001%2C2404.10179%2C2404.11459%2C2404.12195%2C2404.12241%2C2404.12500%2C2404.12608%2C2404.12753%2C2404.12920&max_results=50 (retrieved 2026-11-05T23:00:57Z; SHA-256 84cf130d4e34f4d2e5016ed0458fad86c5211303868cc25cb70d2e17a648fb60)