Dataset · Hugging Face

Ayushnangia/docmath-eval-failures-200

Name: docmath-eval-failures-200
Creator: Ayushnangia
License: mit
Keywords: task_categories:question-answering, task_categories:text-generation, language:en, license:mit, size_categories:1K<n<10K, format:parquet, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, arxiv:2311.09805, region:us, finance

DocMath-Eval Failures 200: Agent Benchmark & Leaderboard A curated benchmark of 200 challenging financial math questions that leading AI models failed to answer correctly, with comprehensive evaluation results from multiple AI agents. Leaderboard Evaluated on 2026-02-21 using LLM-as-Judge (Qwen QwQ-32B) for soft scoring. Rank Agent Model Exact Match Judge: Exact Judge: Approx Judge: Total Wrong Avg Duration Avg Tool Calls 1 TRAE Agent Opus 4.5 98/200 (49.0%) 96… See the full description on the dataset page: https://huggingface.co/datasets/Ayushnangia/docmath-eval-failures-200.

View on Hugging FaceReport an issue

Author / organization	Ayushnangia
License (as declared)	mit
Downloads	23.8K (as reported by Hugging Face)
Likes	0
Created	20 February 2026
Last updated at source	21 February 2026

financemathnumerical-reasoningbenchmarkevaluationagenttool-usedocmathleaderboardllm-as-judge

Embed this entry

<iframe src="https://silytics.si/embed/item/08e56d4e-838a-45bf-b388-ce9abbbba30d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.