Dataset · Hugging Face

cabbage972/GitChameleon-2.0

Name: GitChameleon-2.0
Creator: cabbage972
License: mit
Keywords: task_categories:text-generation, task_categories:question-answering, language:en, language:code, license:mit, size_categories:n<1K, format:json, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, arxiv:2507.12367, region:us, code

GitChameleon 2.0 GitChameleon 2.0 is an AI coding benchmark comprising 328 Python-based problems conditioned on specific versions of popular libraries for scientific computing and web development. It evaluates whether AI code generation models can correctly use library APIs as they existed at a particular version — a challenging test of version-specific knowledge. Note: This is GitChameleon 2.0, a distinct and newer work from the original GitChameleon benchmark. Please do not… See the full description on the dataset page: https://huggingface.co/datasets/cabbage972/GitChameleon-2.0.

View on Hugging FaceReport an issue

Author / organization	cabbage972
License (as declared)	mit
Downloads	352 (as reported by Hugging Face)
Likes	2
Created	17 April 2026
Last updated at source	17 April 2026

codebenchmarkpythonlibrary-versioningcode-generationevaluationcode-completionllm-evaluationversion-compatibilitysoftware-engineering

Embed this entry

<iframe src="https://silytics.si/embed/item/8cd78887-728f-4884-8b51-b32a8308d136" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

352 now. Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.