SGR-Bench: Benchmarking Search Agents on State-Gated Retrieval
Recent advances in large language models and tool-using agents have expanded the range of benchmarked web tasks. Yet an important class of specialized retrieval tasks remains undercharacterized. On many specialized data-retrieval websites, answer-bearing evidence becomes accessible only after establishing the correct site-specific retrieval state through filters, views, hierarchies, or scopes. We term this capability state-gated retrieval (SGR). We introduce SGR-Bench, a benchmark for this setting containing 100 expert-curated tasks spanning six source families and 12 public data ecosystems. Each task requires discovering the appropriate website and configuring its site-specific retrieval...
| Authors | Ningyuan Li, Haiyang Shen, Mugeng Liu et al. |
|---|---|
| Primary category | cs.AI |
| Published | 21 May 2026 |
| Last updated at source | 21 May 2026 |
Connected in the knowledge graph
- PKUAIWeb/SGR-BENCHDataset · cited by
Models and datasets referencing this paper
- PKUAIWeb/SGR-BENCHDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.