SWE-bench-Live/OS-bench

Dataset Format field type instance_id str docker_image str rebuild_cmds list[str] test_cmds list[str] print_cmds list[str] patch str test_patch Optional[str], by default disabled (null) log_parser str PASS_TO_PASS list[str] FAIL_TO_PASS list[str] evaluation code is hosted on GitHub windows2linux split uses Linux docker images which can be run on Linux docker and Docker Desktop (windows/macos system). linux2windows split uses Windows docker… See the full description on the dataset page: https://huggingface.co/datasets/SWE-bench-Live/OS-bench.

<iframe src="https://silytics.si/embed/item/5f5ab284-76bd-4932-9049-77da4f9fb3bd" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.