Dataset · Hugging Face

dimhold/fault-labs

Name: fault-labs
Creator: dimhold
License: mit
Keywords: task_categories:question-answering, language:en, license:mit, size_categories:1K<n<10K, format:json, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, llm-evaluation, tool-use, agents, qwen

fault-labs Author: Dmitriy Semenkevich (dimhold) This dataset measures whether a model reports a broken tool or silently passes the corrupted value on: 560 calls on 7 models from 3 labs (Qwen, DeepSeek, Zhipu), 8 tool modes, 2 framings, 5 trials. Headline, from the repository: "Silent corruption is caught by nobody: 0 out of 140." "EACCES is disclosed in 87.1% of replies." Under a rigid answer format, disclosure of a loud failure falls from 91.4% to 37.1%. The repository says… See the full description on the dataset page: https://huggingface.co/datasets/dimhold/fault-labs.

View on Hugging FaceReport an issue

Author / organization	dimhold
License (as declared)	mit
Downloads	0 (as reported by Hugging Face)
Likes	0
Created	22 October 2026
Last updated at source	22 October 2026

llm-evaluationtool-useagentsqwendeepseekglm

Embed this entry

<iframe src="https://silytics.si/embed/item/39fbcd4d-7369-4aa0-8e96-e7d31f81cf3b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from dimhold

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 22 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.