Dataset · Hugging Face

Skywork/SkyPile-150B

Name: SkyPile-150B
Creator: Skywork
Keywords: task_categories:text-generation, language:zh, size_categories:1M<n<10M, format:json, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, arxiv:2310.19341, region:us, llm , casual-lm, language-modeling

SkyPile-150B Dataset Summary SkyPile-150B is a comprehensive, large-scale Chinese dataset specifically designed for the pre-training of large language models. It is derived from a broad array of publicly accessible Chinese Internet web pages. Rigorous filtering, extensive deduplication, and thorough sensitive data filtering have been employed to ensure its quality. Furthermore, we have utilized advanced tools such as fastText and BERT to filter out low-quality data. The… See the full description on the dataset page: https://huggingface.co/datasets/Skywork/SkyPile-150B.

View on Hugging FaceReport an issue

Author / organization	Skywork
Downloads	14.7K (as reported by Hugging Face)
Likes	415
Created	23 October 2023
Last updated at source	7 December 2023

llm casual-lmlanguage-modeling

Embed this entry

<iframe src="https://silytics.si/embed/item/7324136c-34d6-47ce-9f97-493d97ece93f" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.