OS-Copilot/OSReward

OSReward Benchmark OSReward evaluates whether a multimodal judge can determine if a computer-use agent completed a user's task. This release contains binary outcome labels only: SUCCESS and FAIL. The benchmark has two evaluation configurations: Configuration Trajectories Unique task IDs SUCCESS FAIL full 1,019 656 440 579 hard 284 257 86 198 Load the dataset Load either benchmark configuration with datasets: from datasets import load_dataset… See the full description on the dataset page: https://huggingface.co/datasets/OS-Copilot/OSReward.

<iframe src="https://silytics.si/embed/item/a9d0c2d9-de27-4c6d-8a6f-cb9c068e50f3" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.