Shitao/MLDR
Dataset Summary MLDR is a Multilingual Long-Document Retrieval dataset built on Wikipeida, Wudao and mC4, covering 13 typologically diverse languages. Specifically, we sample lengthy articles from Wikipedia, Wudao and mC4 datasets and randomly choose paragraphs from them. Then we use GPT-3.5 to generate questions based on these paragraphs. The generated question and the sampled article constitute a new text pair to the dataset. The prompt for GPT3.5 is “You are a curious AI… See the full description on the dataset page: https://huggingface.co/datasets/Shitao/MLDR.
| Author / organization | Shitao |
|---|---|
| License (as declared) | mit |
| Downloads | 2K (as reported by Hugging Face) |
| Likes | 83 |
| Created | 2 February 2024 |
| Last updated at source | 6 February 2024 |
Popularity, last 2 days
2,007 now (+42 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from Shitao
- Shitao/bge-m3-dataDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.