nuprl/CanItEdit
Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions CanItEdit is a benchmark for evaluating LLMs on instructional code editing, the task of updating a program given a natural language instruction. The benchmark contains 105 hand-crafted Python programs with before and after code blocks, two types of natural language instructions (descriptive and lazy), and a hidden test suite. The dataset’s dual natural language instructions test… See the full description on the dataset page: https://huggingface.co/datasets/nuprl/CanItEdit.
| Author / organization | nuprl |
|---|---|
| License (as declared) | mit |
| Downloads | 1.7K (as reported by Hugging Face) |
| Likes | 15 |
| Created | 11 December 2023 |
| Last updated at source | 19 March 2024 |
Popularity, last 2 days
1,662 now (+16 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 17 Oct 2026 Description: Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions CanItEdit is a benchmark for evaluating LLMs on instructional code editing, the task of updating a program given a natural language instruction → Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions CanItEdit is a benchmark for evaluating LLMs on instructional code editing, the task of updating a program given a natural language instruction
Changes detected by Silytics between refreshes of the source.
More from nuprl
- nuprl/MultiPL-EDataset
- nuprl/AgentPackDataset
- nuprl/MultiPL-E-completionsDataset
- nuprl/MultiPL-TDataset
- nuprl/EditPackFTDataset
- nuprl/stack-dedup-python-testgen-starcoder-filter-v2Dataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.