ibm-research/900K-Judgements

900K Judgements: A Large-Scale LLM-as-a-Judge Evaluation Dataset Dataset Description This dataset contains approximately 900,000 pairwise comparison judgements from multiple LLM judges evaluating model responses. The data was collected as part of the paper [`Mediocrity is the key for LLM as a Judge Anchor Selection'](https://arxiv.org/abs/2603.16848), investigating the impact of anchor selection in LLM-as-a-judge pairwise evaluation. Dataset Summary… See the full description on the dataset page: https://huggingface.co/datasets/ibm-research/900K-Judgements.

<iframe src="https://silytics.si/embed/item/334d3bad-daf3-4bd3-b44e-932b7bd7cdd2" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.