L3Cube-IndicQuest v2: A Large-Scale Multilingual Benchmark for Evaluating Factual Knowledge of Large Language Models Across Indic Languages
We present L3Cube-IndicQuest v2, a large-scale gold-standard multilingual question-answering benchmark for evaluating the India-specific factual knowledge of Large Language Models (LLMs). The benchmark comprises 3,471 curriculum-grounded English question--answer pairs spanning nine domains, curated from educational curricula, competitive examination materials, and domain-specific reference books. We introduce a practical hybrid construction strategy that combines context-grounded LLM-based question generation and validation with semantic deduplication and human verification, enabling scalable creation of benchmark data while preserving annotation quality. The benchmark is translated into ...
| Authors | Rinit Jain, Tirthraj Mahajan, Advait Joshi et al. |
|---|---|
| Primary category | cs.CL |
| Published | 16 August 2026 |
| Last updated at source | 16 August 2026 |
Connected in the knowledge graph
- l3cube-pune/IndicQuest-v2Dataset · cited by
Models and datasets referencing this paper
- l3cube-pune/IndicQuest-v2Dataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.