Dataset · Hugging Face

SamuelChien821/devopsbench-100

Name: devopsbench-100
Creator: SamuelChien821
License: cc-by-4.0
Keywords: task_categories:text-generation, language:en, license:cc-by-4.0, size_categories:n<1K, modality:text, region:us, devops, sre, software-engineering, benchmark, agents, mcp, deterministic-evaluation

DevOpsBench-100 DevOpsBench-100 is a synthetic long-horizon software-engineering / SRE agent benchmark: 100 tasks over one executable world ("NovaCart", a mid-size e-commerce SaaS) with 72 SQLite tables, 1451 seeded rows, a 38-file monorepo with 417 commits, and 97 MCP tools spanning a first-party engineering stack (tickets, PRs, CI, deployments, canaries, migrations, feature flags, metrics, alerts, incidents, chat, knowledge base) plus deliberately disagreeing vendor-shaped… See the full description on the dataset page: https://huggingface.co/datasets/SamuelChien821/devopsbench-100.

View on Hugging FaceReport an issue

Author / organization	SamuelChien821
License (as declared)	cc-by-4.0
Downloads	2.7K (as reported by Hugging Face)
Likes	0
Created	26 August 2026
Last updated at source	31 August 2026

devopssresoftware-engineeringbenchmarkagentsmcpdeterministic-evaluation

Embed this entry

<iframe src="https://silytics.si/embed/item/e9f07048-dc44-4cae-abc8-8d45b59e57d3" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from SamuelChien821

SamuelChien821/salesbench-100Dataset
SamuelChien821/counselbench-100Dataset
SamuelChien821/hubbenchDataset
SamuelChien821/factorybench-100Dataset
SamuelChien821/typed-decision-benchDataset
SamuelChien821/blobfish-domainbench-24Dataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.