Dataset · Hugging Face

Mithilss/reclaim

Name: reclaim
Creator: Mithilss
License: cc-by-4.0
Keywords: language:en, license:cc-by-4.0, size_categories:n<1K, format:json, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, benchmark, reproducibility, agents, llm-agents

RECLAIM RECLAIM is a benchmark of 100 NeurIPS 2025 papers for measuring whether an AI agent can reproduce a published machine learning result. For each paper the benchmark fixes, before any agent starts, the central claim, the single result a run has to recover, what counts as a successful reproduction, the artifacts the authors released, a difficulty tier, and an audited GPU-hour estimate. This repository holds the benchmark rows. The agent harness, the grading rubric, the… See the full description on the dataset page: https://huggingface.co/datasets/Mithilss/reclaim.

View on Hugging FaceReport an issue

Author / organization	Mithilss
License (as declared)	cc-by-4.0
Downloads	142 (as reported by Hugging Face)
Likes	0
Created	19 June 2026
Last updated at source	20 September 2026

benchmarkreproducibilityagentsllm-agentsmachine-learning

Embed this entry

<iframe src="https://silytics.si/embed/item/cd303d0d-8cb1-4e4a-a8fb-023472be5e92" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

142 now (+3 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from Mithilss

Mithilss/distillation-stream-tracesDataset
Mithilss/neurips-2025-arxiv-latex-sourcesDataset
Mithilss/pdf-iaDataset
Mithilss/finance-dataDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.