Dataset · Hugging Face
nwdxlgzs/sentence-pt-enzh-tr
原数据集:https://huggingface.co/datasets/TigerResearch/pretrain_en、https://huggingface.co/datasets/TigerResearch/pretrain_zh 这个数据集就是把数据切断成句了,没想到行数居然接近1:1哦 中文数据总行数: 434818374 英文数据总行数: 450173542 中文比例: 0.4913, 英文比例: 0.5087 merge是中英混合后的版本(每个文件都有中英文且尽可能保持一样的比例后内部打乱,混训的直接按量节选即可),处理程序遗漏了最后几批数据,导致只有210个4M条的文件(69GB)。
| Author / organization | nwdxlgzs |
|---|---|
| License (as declared) | mit |
| Downloads | 685 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 15 September 2025 |
| Last updated at source | 16 September 2025 |
Popularity, last 3 days
685 now (-45 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from nwdxlgzs
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.