ClawArena: Benchmarking AI Agents in Evolving Information Environments
AI agents deployed as persistent assistants must maintain correct beliefs as their information environment evolves. In practice, evidence is scattered across heterogeneous sources that often contradict one another, new information can invalidate earlier conclusions, and user preferences surface through corrections rather than explicit instructions. Existing benchmarks largely assume static, single-authority settings and do not evaluate whether agents can keep up with this complexity. We introduce ClawArena, a benchmark for evaluating AI agents in evolving information environments. Each scenario maintains a complete hidden ground truth while exposing the agent only to noisy, partial, and s...
| Authors | Haonian Ji, Kaiwen Xiong, Siwei Han et al. |
|---|---|
| Primary category | cs.LG |
| Published | 5 April 2026 |
| Last updated at source | 16 May 2026 |
Connected in the knowledge graph
- Haonian/ClawArenaDataset · cited by
Models and datasets referencing this paper
- Haonian/ClawArenaDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.