Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions
As browser-use agents improve, benchmarks keep pace by collecting new tasks, websites, and applications, often making tasks longer or more novel. This makes difficulty expensive to refresh and difficult to control: when many aspects change at once, it is unclear what actually makes a task challenging. We instead construct challenging instances from tasks agents already solve, turning difficulty into a programmable property of the environment. BreakingWeb pairs every base task with an intervention condition that preserves the user instruction, latent target, and backend success criterion while changing the environment at different web stack layers. Each intervention is deterministic, detec...
| Authors | Xunjian Yin, Tianchen Guan, Jinao Wang et al. |
|---|---|
| Primary category | cs.CL |
| Published | 20 September 2026 |
| Last updated at source | 20 September 2026 |
Connected in the knowledge graph
- BreakingWeb/breakingweb-results-v2Dataset · cited by
- BreakingWeb/breakingweb-results-v3Dataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.