mantra-anon/MANTRA
MANTRA A benchmark for action-taking LLMs. Each test case gives the agent a natural-language scenario, a long policy document, and a set of tools, then scores the resulting tool-call trace against machine-checkable properties derived from the document. This package is self-contained: the harness, six environment packages, the minimum vendored tau2-bench subset, and 285 test cases across six domains all ship together. Running an evaluation requires only the harness deps (no… See the full description on the dataset page: https://huggingface.co/datasets/mantra-anon/MANTRA.
| Author / organization | mantra-anon |
|---|---|
| License (as declared) | cc-by-4.0 |
| Downloads | 189 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 7 May 2026 |
| Last updated at source | 7 May 2026 |
Popularity, last 2 days
189 now (-2 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 17 Oct 2026 Description: MANTRA A benchmark for action-taking LLMs. Each test case gives the agent a natural-language scenario, a long policy document, and a set of tools, then scores the resulting tool-call trace against machine-checkable properties derived from t → MANTRA A benchmark for action-taking LLMs. Each test case gives the agent a natural-language scenario, a long policy document, and a set of tools, then scores the resulting tool-call trace against machine-checkable properties derived from t
Changes detected by Silytics between refreshes of the source.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.