Dataset · Hugging Face

xzx34/cross-lingual-pitfalls

Name: cross-lingual-pitfalls
Creator: xzx34
License: mit
Keywords: task_categories:question-answering, task_categories:multiple-choice, language:en, language:zh, language:ja, language:ko, language:fr, language:es, language:it, language:uk, language:de, language:bn, language:hi, language:ar, language:he

Cross-Lingual Pitfalls Cross-Lingual Pitfalls is a fixed, failure-focused dataset from the ACL 2025 paper "Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models." It contains 6,713 bilingual English-to-target-language question pairs across 16 target languages. The paper's search-based multilingual LLM evaluation method uses beam search and LLM-based simulation to discover cases where a model answers correctly in English but fails… See the full description on the dataset page: https://huggingface.co/datasets/xzx34/cross-lingual-pitfalls.

View on Hugging FaceReport an issue

Author / organization	xzx34
License (as declared)	mit
Downloads	181 (as reported by Hugging Face)
Likes	0
Created	29 June 2026
Last updated at source	21 September 2026

multilingualcross-lingualllm-evaluationbenchmarkmultilingual-llmcross-lingual-consistencycross-lingual-weaknessmultilingual-evaluationautomatic-probingfailure-discoverysearch-based-evaluationadversarial-evaluationmultilingual-post-training

Embed this entry

<iframe src="https://silytics.si/embed/item/96027d95-25a5-4ab2-85cd-0afaf1fe6f33" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

181 now (+3 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from xzx34

xzx34/Grid-BenchDataset
xzx34/SocialMazeDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.