Rohithreddybc/judgesense-benchmark

JudgeSense A benchmark for measuring whether an LLM judge returns the same verdict when the same evaluation request is worded differently. The question is deliberately narrow. This dataset does not measure whether a judge is correct; it measures whether it is reproducible. A judge that is wrong on every item but wrong identically under both phrasings scores perfectly here, and that is intended: a measuring instrument whose reading depends on how you phrase the question is not… See the full description on the dataset page: https://huggingface.co/datasets/Rohithreddybc/judgesense-benchmark.

<iframe src="https://silytics.si/embed/item/19eb3b54-4afd-4c98-ac08-58a1a3421148" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.