Dataset · Hugging Face

thaki-AI/daily-paper-2026-10-04-grader-confound-agentic-rankings

Name: daily-paper-2026-10-04-grader-confound-agentic-rankings
Creator: thaki-AI
License: cc-by-4.0
Keywords: language:en, license:cc-by-4.0, region:us, llm-as-judge, evaluation-validity, tool-calling, agentic-evaluation, deterministic-grading, benchmark-audit, cost-quality-frontier, pre-registration

The Grader Confound: Measuring How Grader Choice Inverts the Measured Cost-Quality Rankings of Agentic Tool-Call Arms on Self-Hosted H200 TL;DR — Graders are instruments, not free observations. We give a cell-level formal model of exactly when switching between a deterministic AST grader, a surface-pattern gate, and an LLM judge inverts the measured cost-quality rankings of agentic tool-call arms, price the judge in tokens (the grade tax), and pre-register a three-grader audit… See the full description on the dataset page: https://huggingface.co/datasets/thaki-AI/daily-paper-2026-10-04-grader-

View on Hugging FaceReport an issue

Author / organization	thaki-AI
License (as declared)	cc-by-4.0
Downloads	141 (as reported by Hugging Face)
Likes	0
Created	4 October 2026
Last updated at source	4 October 2026

llm-as-judgeevaluation-validitytool-callingagentic-evaluationdeterministic-gradingbenchmark-auditcost-quality-frontierpre-registration

Embed this entry

<iframe src="https://silytics.si/embed/item/a5664eb4-eb94-432e-a5d6-1c67b24715e1" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

141 now (+3 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from thaki-AI

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.