Evaluating Cross-lingual Knowledge Consistency in Code-Mixed vis-a-vis Indian Languages using IndicKLAR
Large language models often exhibit a substantial gap between their performance in English and in lower-resourced languages on equivalent knowledge queries---a cross-lingual consistency issue that remains underexplored for Indian languages and their code-mixed counterparts. To study this gap, we introduce IndicKLAR, an Indic extension of the KLAR-CLC benchmark covering 18 of the 22 scheduled Indian languages. For 11 widely used language pairs, we additionally provide code-mixed variants. Both monolingual and code-mixed inputs verified by native speakers. This three-way alignment enables us to examine how knowledge recall consistency varies across English, code-mixed, and native Indian lan...
| Authors | Debajyoti Mazumder, Divyansh Pathak, Prashant Kodali et al. |
|---|---|
| Primary category | cs.CL |
| Published | 28 May 2026 |
| Last updated at source | 29 September 2026 |
Connected in the knowledge graph
- debajyotimaz/IndicKLARDataset · cited by
Models and datasets referencing this paper
- debajyotimaz/IndicKLARDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.