Dataset · Hugging Face

gonglinyuan/real_fim_eval

Name: real_fim_eval
Creator: gonglinyuan
License: cc-by-4.0
Keywords: language:en, license:cc-by-4.0, size_categories:10K<n<100K, format:json, modality:text, library:datasets, library:pandas, library:mlcroissant, library:polars, arxiv:2506.00204, region:us, code-generation, code-infilling, fill-in-the-middle

Real-FIM-Eval Benchmark Real-FIM-Eval is a benchmark to evaluate Fill-in-the-Middle (FIM) capabilities of code LLMs in scenarios that reflect real-world code completion. Real-FIM-Eval is built using data from GitHub commits between Jan. 2025 and Feb. 2025. These commits originate from 228 permissively licensed GitHub repositories with 10,000+ stars, spanning the top 12 widely-used programming languages. Paper: https://arxiv.org/abs/2506.00204 We process git commits using… See the full description on the dataset page: https://huggingface.co/datasets/gonglinyuan/real_fim_eval.

View on Hugging FaceReport an issue

Author / organization	gonglinyuan
License (as declared)	cc-by-4.0
Downloads	208 (as reported by Hugging Face)
Likes	2
Created	18 May 2025
Last updated at source	3 June 2025

code-generationcode-infillingfill-in-the-middle

Embed this entry

<iframe src="https://silytics.si/embed/item/b7f26082-d9eb-4476-acd0-59231a5b54b4" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

208 now (+33 since 2026-10-18). Counts as reported by the source, snapshotted daily by Silytics.

More from gonglinyuan

gonglinyuan/safimDataset
gonglinyuan/CoSQADataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.