Dataset · Hugging Face

kernel-14/SemanticAlign-Bench

Name: SemanticAlign-Bench
Creator: kernel-14
License: cc-by-4.0
Keywords: task_categories:question-answering, task_categories:text-generation, annotations_creators:expert-generated, language_creators:found, language:en, license:cc-by-4.0, size_categories:1K<n<10K, format:imagefolder, modality:image, library:datasets, library:mlcroissant, region:us, research-papers, machine-learning, benchmarking

SemanticAlign-Bench A benchmark for evaluating AI agents on structured claim extraction from top-tier ML conference papers. Each paper is decomposed into Semantic Alignment Units (SAU) — atomic, self-contained implementation propositions — across four diagnostic dimensions spanning numerical precision to pipeline-level workflow. Agents are evaluated on whether they can reproduce these claims without hallucination, omission, or misordering. The Four SAU Dimensions… See the full description on the dataset page: https://huggingface.co/datasets/kernel-14/SemanticAlign-Bench.

View on Hugging FaceReport an issue

Author / organization	kernel-14
License (as declared)	cc-by-4.0
Downloads	194 (as reported by Hugging Face)
Likes	1
Created	10 May 2026
Last updated at source	14 May 2026

research-papersmachine-learningbenchmarkingllm-evaluationfactualitystructured-extractionpaper-understandingpaper-to-code

Embed this entry

<iframe src="https://silytics.si/embed/item/e7d4eae8-7634-454b-95b9-836e5c58132e" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.