Knowledge Index of Noah's Ark
Knowledge benchmarks for LLMs face three issues: scaling-driven designs that do not operationalize disciplinary representativeness; flat-payment annotation that permits lazy consensus; and unaudited ranking instability under bounded test budgets. We introduce KINA, an 899-item benchmark across 261 fine-grained disciplines, with two formal results. First, we cast representativeness as a coverage-style objective over expert-elicited anchors and operationalize disciplinary representativeness through a proxy, yielding a (1-1/e) greedy approximation (Proposition 1); the guarantee applies to the proxy, not to population representativeness. Second, we prove a bonus-on-bar tournament weakly FOSD-...
| Authors | Sheng Jin, Minghao Liu, Yunze Xiao et al. |
|---|---|
| Primary category | cs.AI |
| Published | 3 June 2026 |
| Last updated at source | 4 June 2026 |
Connected in the knowledge graph
- 2077AIDataFoundation/KINADataset · cited by
Models and datasets referencing this paper
- 2077AIDataFoundation/KINADataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.