Sign inGet started
Dataset · Hugging Face

choyiny/decidebench

DecideBench Accuracy, cost and latency of decision models, measured together. A decision model takes an input, a question and a short list of options, and returns one option key. JEV (TypeSafe's "System One" model) made the category popular, and a dozen open alternatives followed. DecideBench measures accuracy, cost per decision and latency for 20 decision models (TEV both hosted and self-hosted) and 3 general-purpose LLMs on 400 decisions, and reports Pareto frontiers instead… See the full description on the dataset page: https://huggingface.co/datasets/choyiny/decidebench.

Author / organizationchoyiny
License (as declared)cc-by-4.0
Downloads1.5K (as reported by Hugging Face)
Likes4
Created29 September 2026
Last updated at source14 October 2026
decision-modelsbenchmarkcostlatency
Embed this entry
<iframe src="https://silytics.si/embed/item/e181e072-0e55-40a2-8f6c-1ef8e8b9a30a" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.