cruxeval-org/cruxeval

CRUXEval: Code Reasoning, Understanding, and Execution Evaluation 🏠 Home Page • 💻 GitHub Repository • 🏆 Leaderboard • 🔎 Sample Explorer CRUXEval (Code Reasoning, Understanding, and eXecution Evaluation) is a benchmark of 800 Python functions and input-output pairs. The benchmark consists of two tasks, CRUXEval-I (input prediction) and CRUXEval-O (output prediction). The benchmark was constructed as follows: first, we use Code Llama 34B to generate a large set of… See the full description on the dataset page: https://huggingface.co/datasets/cruxeval-org/cruxeval.

<iframe src="https://silytics.si/embed/item/26f54e68-3060-46fe-a5e3-ee10775c8358" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.