papluca/language-identification
Dataset Card for Language Identification dataset Dataset Summary The Language Identification dataset is a collection of 90k samples consisting of text passages and corresponding language label. This dataset was created by collecting data from 3 sources: Multilingual Amazon Reviews Corpus, XNLI, and STSb Multi MT. Supported Tasks and Leaderboards The dataset can be used to train a model for language identification, which is a multi-class text… See the full description on the dataset page: https://huggingface.co/datasets/papluca/language-identification.
| Author / organization | papluca |
|---|---|
| Downloads | 5.7K (as reported by Hugging Face) |
| Likes | 71 |
| Created | 2 March 2022 |
| Last updated at source | 15 July 2022 |
Popularity, last 2 days
5,682 now (-7 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- onnx-community/xlm-roberta-base-language-detection-ONNXModel · used to train
- papluca/xlm-roberta-base-language-detectionModel · used to train
- dominguesm/xlm-roberta-base-lora-language-detectionModel · used to train
Recent changes
- 17 Oct 2026 Description: Dataset Card for Language Identification dataset Dataset Summary The Language Identification dataset is a collection of 90k samples consisting of text passages and corresponding language label. This dataset was created by collecting data fr → Dataset Card for Language Identification dataset Dataset Summary The Language Identification dataset is a collection of 90k samples consisting of text passages and corresponding language label. This dataset was created by collecting data fr
Changes detected by Silytics between refreshes of the source.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.