Dataset · Hugging Face

eduagarcia/OSCAR-2301-pt_dedup

Name: OSCAR-2301-pt_dedup
Creator: eduagarcia
Keywords: task_categories:text-generation, source_datasets:extended|oscar-corpus/OSCAR-2301, language:pt, size_categories:10M<n<100M, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, arxiv:2107.06499, arxiv:2201.06642, region:us

OSCAR-2301-PT (deduplicated) OSCAR-2301-PT (deduplicated) is a curation from OSCAR-2301 in the Portuguese language, depuplicated by MinHash algorithm and Locality Sensitive Hashing, following the approach of Lee et al. (2022). This version of the dataset is the portuguese subset from OSCAR-2301. OSCAR-2301 is a multilingual corpus extracted from the November/December 2022 dump of Common Crawl. Statistics We used 5-grams and a signature of size 256, considering two… See the full description on the dataset page: https://huggingface.co/datasets/eduagarcia/OSCAR-2301-pt_dedup.

View on Hugging FaceReport an issue

Author / organization	eduagarcia
Downloads	217 (as reported by Hugging Face)
Likes	0
Created	27 August 2023
Last updated at source	29 January 2024

Embed this entry

<iframe src="https://silytics.si/embed/item/d59236e7-ad2a-4b41-8fe4-bdaa9767f62f" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

217 now (-21 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from eduagarcia

eduagarcia/CrawlPT_dedupDataset
eduagarcia/tokenizer_benchmark_resultsDataset
eduagarcia/LegalPT_dedupDataset
eduagarcia/enem_challengeDataset
eduagarcia/portuguese_benchmarkDataset
eduagarcia/cc_news_pt_v2Dataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.