Dataset · Hugging Face

tangchen-ai/birdcode-deepswe-k1d

Name: birdcode-deepswe-k1d
Creator: tangchen-ai
License: cc-by-4.0
Keywords: license:cc-by-4.0, size_categories:n<1K, format:csv, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, coding-agent, deepswe, evaluation, agent-harness, swebench

BirdCode on DeepSWE — k=1, single attempt, no web tools ⚠️ Reading the metric correctly: The summary card's "Average f2p 0.89" is the test-case-level pass fraction (f2p_passed/f2p_total, averaged per task) — it is NOT the official DeepSWE leaderboard metric. The official binary score is the reward field (1 only when all F2P and P2P tests pass): 60/113 = 0.531. Per-trial reward values are visible in each trial's rewards block below. Evaluation of BirdCode (a from-scratch… See the full description on the dataset page: https://huggingface.co/datasets/tangchen-ai/birdcode-deepswe-k1d.

View on Hugging FaceReport an issue

Author / organization	tangchen-ai
License (as declared)	cc-by-4.0
Downloads	1.2K (as reported by Hugging Face)
Likes	0
Created	6 September 2026
Last updated at source	17 September 2026

coding-agentdeepsweevaluationagent-harnessswebench

Embed this entry

<iframe src="https://silytics.si/embed/item/9e1ec4fa-23c3-4234-863d-1f82e790b6f8" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

1,161 now (-1 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.