Papajams/beam-audit-bench

Beam Audit Bench Ground-truth benchmark of audit-script generation: can a model read a scientific claim and write self-contained numerical code that recovers the paper's result — with a mandatory positive control? Built from Lemma, an AI-scientist pipeline that audits scientific claims and distrusts itself. Why this benchmark exists During the Lemma audits of two theory papers we hit a hard capability boundary: free 27B-class models could not implement the papers'… See the full description on the dataset page: https://huggingface.co/datasets/Papajams/beam-audit-bench.

<iframe src="https://silytics.si/embed/item/0d27e790-cc20-421f-9518-bc5ab533c54b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 22 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.