HPLT/OpenLID-v3
Dataset Description OpenLID-v3 is an updated version of the OpenLID-v2 dataset (see the CHANGELOG.md). Repository: https://github.com/hplt-project/openlid Paper: OpenLID-v3: Improving the Precision of Closely Related Language Identification – An Experience Report Usage from datasets import load_dataset ds = load_dataset('HPLT/OpenLID-v3', split='train') Dataset Summary The OpenLID-v3 dataset covers 194 language varieties + not-a-language class… See the full description on the dataset page: https://huggingface.co/datasets/HPLT/OpenLID-v3.
| Author / organization | HPLT |
|---|---|
| Downloads | 326 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 15 June 2026 |
| Last updated at source | 18 June 2026 |
Recent changes
- 16 Oct 2026 Description: none → Dataset Description OpenLID-v3 is an updated version of the OpenLID-v2 dataset (see the CHANGELOG.md). Repository: https://github.com/hplt-project/openlid Paper: OpenLID-v3: Improving the Precision of Closely Related Language Identification
- 16 Oct 2026 Topics added task_categories:text-classification removed fasttext, text-classification, language-identification, ace, afr, af, als, amh, am, ara, ar, asm, as, ast, awa, ayr, azb, azj, bak, ba
- 16 Oct 2026 Task: text-classification → none
- 16 Oct 2026 Topics added fasttext, text-classification, language-identification, ace, afr, af, als, amh, am, ara, ar, asm, as, ast, awa, ayr, azb, azj, bak, ba removed task_categories:text-classification
- 16 Oct 2026 Task: none → text-classification
- 16 Oct 2026 Description: none → Dataset Description OpenLID-v3 is an updated version of the OpenLID-v2 dataset (see the CHANGELOG.md). Repository: https://github.com/hplt-project/openlid Paper: OpenLID-v3: Improving the Precision of Closely Related Language Identification
- 16 Oct 2026 Topics added task_categories:text-classification removed fasttext, text-classification, language-identification, ace, afr, af, als, amh, am, ara, ar, asm, as, ast, awa, ayr, azb, azj, bak, ba
- 16 Oct 2026 Task: text-classification → none
Changes detected by Silytics between refreshes of the source.
More from HPLT
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.