acartag7/gap-benchmark
GAP Benchmark: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents Dataset Description The Governance-Action Paradox (GAP) Benchmark contains 17,420 scored interactions measuring whether AI models that refuse harmful requests in text still execute forbidden actions through tool calls. It provides the first large-scale empirical evidence that text-level alignment does not transfer to tool-call behavior. Each row records a single model interaction under… See the full description on the dataset page: https://huggingface.co/datasets/acartag7/gap-benchmark.
| Author / organization | acartag7 |
|---|---|
| License (as declared) | cc-by-4.0 |
| Downloads | 298 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 17 February 2026 |
| Last updated at source | 17 February 2026 |
Popularity, last 3 days
298 now (+5 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: GAP Benchmark: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents Dataset Description The Governance-Action Paradox (GAP) Benchmark contains 17,420 scored interactions measuring whether AI models that refuse harmful requests in → GAP Benchmark: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents Dataset Description The Governance-Action Paradox (GAP) Benchmark contains 17,420 scored interactions measuring whether AI models that refuse harmful requests in
Changes detected by Silytics between refreshes of the source.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.