Dataset · Hugging Face

amazon/AutoSUIT

Name: AutoSUIT
Creator: amazon
License: cc-by-nc-4.0
Keywords: task_categories:text-generation, language:en, license:cc-by-nc-4.0, size_categories:n<1K, format:json, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, code, code-generation, cwe

AutoSUIT Bench (HuggingFace edition) Dynamic, execution-based benchmark for secure code generation by LLMs. Every generated program is compiled/interpreted and run against two independent unit-test suites — a functional suite and a security suite (the latter is designed to fail when the target CWE vulnerability is present). Covers 232 CWEs across C, C++, Java, and Python. Paper: Osebe et al., AutoSUIT Bench — Automated Security UnIt Test Benchmark for LLM Coding, Findings of… See the full description on the dataset page: https://huggingface.co/datasets/amazon/AutoSUIT.

View on Hugging FaceReport an issue

Author / organization	amazon
License (as declared)	cc-by-nc-4.0
Downloads	1.2K (as reported by Hugging Face)
Likes	1
Created	3 July 2026
Last updated at source	3 July 2026

codecode-generationcwe

Embed this entry

<iframe src="https://silytics.si/embed/item/1d4ac9a3-7f7b-4256-8ea1-ee171d03c202" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from amazon

amazon/kaputtDataset
amazon/music-off-policy-evaluation-benchmarkDataset
amazon/ConfBenchDataset
amazon/ABO-EditDataset
amazon/sop-benchDataset
amazon/doc_splitDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.