Dataset · Hugging Face

lucadiliello/wikipedia_512_pretraining

Name: wikipedia_512_pretraining
Creator: lucadiliello
Keywords: language:en, size_categories:1M<n<10M, format:parquet, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, region:us

Dataset Card for "wikipedia_512_pretraining" Wikipedia preprocessed for pretraining of models. Each sample in the dataset has an average tokenized length of 512 RoBERTa-Base tokens.

View on Hugging FaceReport an issue

Author / organization	lucadiliello
Downloads	268 (as reported by Hugging Face)
Likes	15
Created	24 February 2023
Last updated at source	24 March 2023

Embed this entry

<iframe src="https://silytics.si/embed/item/f0a97aee-63a2-4621-8881-c1e23a3710f8" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

268 now (-3 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from lucadiliello

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.