dimhold/tool-failure

tool-failure Author: Dmitriy Semenkevich (dimhold) This dataset measures whether a model's answer reports a broken tool: 100 calls through an MCP server written for the study that breaks its own tool in 5 ways, on claude-haiku-4-5 and claude-opus-5. Headline, from the repository: "When a tool breaks loudly, the model's answer says so 39 times out of 40. When the same tool returns a corrupted value and stays quiet, the answer says so 0 times out of 40." This is a mirror. The… See the full description on the dataset page: https://huggingface.co/datasets/dimhold/tool-failure.

<iframe src="https://silytics.si/embed/item/bd890935-ef83-4158-aa60-bdcbae530684" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 22 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.