Pass or Fail? Evaluating LLMs on Two Greek Examination Benchmarks
The rapid advancement of Large Language Models (LLMs) imposes a thorough evaluation of their linguistic and analytical capabilities as well as constraints, particularly for a language with limited benchmark coverage such as Greek. To address the limited availability of comprehensive benchmarks in this domain, we introduce Prot-Ex and Pan-Ex, two benchmarks consisting of questions from entrance exams for Greek Model and Experimental schools as well as the Panhellenic exams (the Greek national university entrance examinations). These benchmarks are employed to assess the performance of text-only LLMs-including the Greek-adapted KriKri-8B-Instruct, Llama-3.1-8B, Gemma-4-26B, and Qwen-3-32B-a...
| Authors | Panagiota Kyriazi, Eleni Kasoura, Prokopis Prokopidis |
|---|---|
| Primary category | cs.CL |
| Published | 28 September 2026 |
| Last updated at source | 28 September 2026 |
Connected in the knowledge graph
- ilsp/greek-protipa-examsDataset · cited by
- ilsp/panellinies-exams-datasetDataset · cited by
Models and datasets referencing this paper
- ilsp/panellinies-exams-datasetDataset
- ilsp/greek-protipa-examsDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.