wenge-research/yayi2_pretrain_data
介绍/Introduction 本数据集源自雅意训练语料,我们精选了约100B数据,数据大小约为500GB。我们期望通过雅意预训练数据的开源推动中文预训练大模型开源社区的发展,并积极为此贡献力量。通过开源,我们与每一位合作伙伴共同构建雅意大模型生态。 We opensource the pre-trained dataset in this release, it should contain more than 100B tokens depending on the tokenizer you use, requiring more than 500GB of local storage. By open-sourcing the pre-trained dataset, we aim to contribute to the development of the Chinese pre-trained large language model open-source community. Through open-source, we… See the full description on the dataset page: https://huggingface.co/datasets/wenge-research/yayi2_pretrain_data.
| Author / organization | wenge-research |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 1.3K (as reported by Hugging Face) |
| Likes | 60 |
| Created | 25 December 2023 |
| Last updated at source | 29 December 2023 |
Popularity, last 3 days
1,250 now (-57 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 17 Oct 2026 Description: 介绍/Introduction 本数据集源自雅意训练语料,我们精选了约100B数据,数据大小约为500GB。我们期望通过雅意预训练数据的开源推动中文预训练大模型开源社区的发展,并积极为此贡献力量。通过开源,我们与每一位合作伙伴共同构建雅意大模型生态。 We opensource the pre-trained dataset in this release, it should contain more than 100B tokens depending on the to → 介绍/Introduction 本数据集源自雅意训练语料,我们精选了约100B数据,数据大小约为500GB。我们期望通过雅意预训练数据的开源推动中文预训练大模型开源社区的发展,并积极为此贡献力量。通过开源,我们与每一位合作伙伴共同构建雅意大模型生态。 We opensource the pre-trained dataset in this release, it should contain more than 100B tokens depending on the to
Changes detected by Silytics between refreshes of the source.
More from wenge-research
- wenge-research/yayi_uie_sft_dataDataset
- wenge-research/TableEvalDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.