bzantium/bigcodebench

BigCodeBench (ported) Fork of bigcode/bigcodebench v0.1.4. canonical_solution and test are ported to current numpy / pandas / scikit-learn so that the reference solutions pass on a modern stack. Prompts (complete_prompt, instruct_prompt, code_prompt) are unchanged, so the task a model is asked to solve is identical to upstream. Groundtruth pass rate: 1.000 over all 1140 tasks.

<iframe src="https://silytics.si/embed/item/b6ee00c1-a02c-4521-9fac-4a9a744640b5" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.