Dataset · Hugging Face

BraintrustDataDev/swebench-django

Name: swebench-django
Creator: BraintrustDataDev
License: bsd-3-clause
Keywords: task_categories:text-generation, language:en, license:bsd-3-clause, size_categories:n<1K, format:json, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, code, swe-bench, django, agents

SWE-bench Django (30-task subset) Thirty real bug-fix tasks from the Django project, derived from SWE-bench (Jimenez, Yang, et al., ICLR 2024). Each task is a merged pull request rewound to its buggy commit: an agent gets only the issue text, must locate and fix the bug in the codebase, and the fix is checked against the PR's held-out test. This subset powers a Braintrust eval on behavior-vs-output scoring — whether a coding agent obeys a "locate code via vector search only"… See the full description on the dataset page: https://huggingface.co/datasets/BraintrustDataDev/swebench-django.

View on Hugging FaceReport an issue

Author / organization	BraintrustDataDev
License (as declared)	bsd-3-clause
Downloads	127 (as reported by Hugging Face)
Likes	0
Created	16 August 2026
Last updated at source	16 August 2026

codeswe-benchdjangoagentscode-generationevaluation

Embed this entry

<iframe src="https://silytics.si/embed/item/9596d29b-b210-4e74-a557-ae151724cb2b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.