Leonharper/naime-corpus-v1
Naime Corpus v1 多领域通用预训练语料库，使用 Qwen3-8B tokenizer 分词。 数据规格 指标 数值 总 Tokens ~281亿 (28.1B) 总文档数 38,186,704 序列长度 4096 格式 Parquet (ZSTD) 分片数 1736 总大小 ~42 GB 分词器 Qwen/Qwen3-8B 领域分布 领域 文档数 占比 general_en 21,608,669 56.6% general_zh 10,762,743 28.2% wiki_en 3,983,641 10.4% wiki_zh 844,764 2.2% math 628,510 1.6% code 358,377 0.9% Schema input_ids: List[uint32] (length 4096) chunk_idx:… See the full description on the dataset page: https://huggingface.co/datasets/Leonharper/naime-corpus-v1.
| Author / organization | Leonharper |
|---|---|
| License (as declared) | mit |
| Downloads | 182 (as reported by Hugging Face) |
| Likes | 2 |
| Created | 30 May 2026 |
| Last updated at source | 31 May 2026 |
Popularity, last 3 days
182 now (-6 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.