wanng/wikipedia-zh-mnbvc
zhwiki-mnbvc 分项目：爬取并处理中文维基百科语料 数据时间：202302-202305 （持续更新） 主项目：MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集 https://github.com/esbatmop/MNBVC 该项目清洗流程主要参考：https://kexue.fm/archives/4176/comment-page-1 并且使用组员开发的去重工具进行数据格式化。 总行数（样本）: 10,754,146 一个示例： { "文件名": "cleaned/zhwiki-20230420/folder_0/723712.txt", "是否待查文件": false, "是否重复文件": false, "文件大小": 558, "simhash": 14363740497821204542, "最长段落长度": 142, "段落数": 6, "去重段落数": 6, "低质量段落数": 0, "段落": [ {… See the full description on the dataset page: https://huggingface.co/datasets/wanng/wikipedia-zh-mnbvc.
| Author / organization | wanng |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 202 (as reported by Hugging Face) |
| Likes | 6 |
| Created | 29 May 2023 |
| Last updated at source | 29 May 2023 |
Popularity, last 2 days
202 now (+8 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from wanng
- wanng/wukong100mDataset
- wanng/laion-high-resolution-chineseDataset
- wanng/midjourney-v5-202304-cleanDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.