Dataset · Hugging Face

microsoft/ThinkingBox-Bench

Name: ThinkingBox-Bench
Creator: microsoft
License: cdla-permissive-2.0
Keywords: task_categories:reinforcement-learning, language:en, license:cdla-permissive-2.0, size_categories:n<1K, format:parquet, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, arxiv:2608.19741, region:us, agent, tool-use, benchmark

ThinkingBox-Bench ThinkingBox-Bench is an executable benchmark for evaluating whether tool-using LLM agents can reliably complete stateful business workflows. Version 1.0 contains 507 tool-agent-user tasks across retail and e-commerce, travel and hospitality, auto insurance, neobank support, and consulting IT/HR support. This dataset repository provides a browsable representation of the benchmark. The executable benchmark, tool servers, and supporting fixtures are maintained in… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/ThinkingBox-Bench.

View on Hugging FaceReport an issue

Author / organization	microsoft
License (as declared)	cdla-permissive-2.0
Downloads	251 (as reported by Hugging Face)
Likes	16
Created	24 August 2026
Last updated at source	27 August 2026

agenttool-usebenchmarkevaluation

Embed this entry

<iframe src="https://silytics.si/embed/item/f33aa14d-8c9a-4b26-a4fa-feda08ac6275" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from microsoft

microsoft/ms_marcoDataset
microsoft/NOTSOFARDataset
microsoft/orca-math-word-problems-200kDataset
microsoft/CABRADataset
microsoft/rStar-CoderDataset
microsoft/wiki_qaDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.