Dataset · Hugging Face

pbtbench-team/pbt-bench

Name: pbt-bench
Creator: pbtbench-team
License: cc-by-4.0
Keywords: task_categories:text-generation, language:en, license:cc-by-4.0, size_categories:10K<n<100K, format:csv, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, property-based-testing, hypothesis, llm-agents, code-evaluation

PBT-Bench: Benchmarking AI Agents on Property-Based Testing PBT-Bench is a benchmark of 100 curated property-based testing problems across 40 Python libraries, accompanied by 4,800 evaluation trajectories from 8 contemporary LLMs and 2,000 post-review trajectories (Claude Opus 4.8, Claude Code, and a prompt ablation with two prompt paraphrases). Paper: PBT-Bench: Benchmarking AI Agents on Property-Based Testing, NeurIPS 2026 Evaluations and Datasets Track. Code:… See the full description on the dataset page: https://huggingface.co/datasets/pbtbench-team/pbt-bench.

View on Hugging FaceReport an issue

Author / organization	pbtbench-team
License (as declared)	cc-by-4.0
Downloads	237 (as reported by Hugging Face)
Likes	0
Created	4 May 2026
Last updated at source	29 September 2026

property-based-testinghypothesisllm-agentscode-evaluationbug-detectionfail-to-passbenchmarkingpython

Embed this entry

<iframe src="https://silytics.si/embed/item/7e1b86bf-e90d-4a7c-ad58-55baa0e5a10b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

237 now (-8 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.