Tropic-AI/lumen-bench
Lumen-bench A multilingual benchmark for evaluating what tool-calling language models do, not just what they say. It measures harmful tool use, including cases where a model refuses in words but still performs the requested action. Paper · Dataset · Code The benchmark evaluates 30 models on 108 scenarios, in Portuguese, English, Spanish, Mandarin Chinese, and Hindi, with six pressure conditions, two system prompts, and 21 tools: 194,400 trials. It also includes 3,300… See the full description on the dataset page: https://huggingface.co/datasets/Tropic-AI/lumen-bench.
| Author / organization | Tropic-AI |
|---|---|
| License (as declared) | cc-by-4.0 |
| Downloads | 255 (as reported by Hugging Face) |
| Likes | 1 |
| Created | 4 October 2026 |
| Last updated at source | 10 October 2026 |
Popularity, last 2 days
255 now (+42 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from Tropic-AI
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.