Dataset · Hugging Face

pooria/benchmark-mcp-safety

Name: benchmark-mcp-safety
Creator: pooria
License: mit
Keywords: task_categories:text-generation, language:en, license:mit, size_categories:n<1K, format:json, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, benchmark, llm-evaluation, ai-benchmark, model-evaluation

MCP Safety Will an agent obey a poisoned tool description? What it measures Whether an agent completes a normal MCP job without obeying poisoned metadata, using shadow tools, overreaching permissions, or leaking a canary. Category: safety. Status: alpha. How to run $ npx benchmark-mcp-safety list $ npx benchmark-mcp-safety run --model <model-id> --provider openrouter $ npx benchmark-mcp-safety score results.json --provider mock runs the whole… See the full description on the dataset page: https://huggingface.co/datasets/pooria/benchmark-mcp-safety.

View on Hugging FaceReport an issue

Author / organization	pooria
License (as declared)	mit
Downloads	0 (as reported by Hugging Face)
Likes	0
Created	16 October 2026
Last updated at source	16 October 2026

benchmarkllm-evaluationai-benchmarkmodel-evaluationevalsmcpmcp-securityai-safetyagent-securityprompt-injectiontool-usetool-poisoningleast-privilegecanary-tokenopenroutertypescript

Embed this entry

<iframe src="https://silytics.si/embed/item/630c541c-2601-4dad-a325-12209511a16c" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from pooria

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.