Tele-AI/TeleChat-PTD
TeleChat预训练数据集(TeleChat-PTD) 🤗 Hugging Face • 🏔 MindSpore️ • 🦉 github️ • 🐾 gitee️ • 💬 WeChat Tech Report 数据介绍 TeleChat-PTD 是由电信星辰大模型TeleChat预训练语料中抽取出的的综合性大规模中文数据集。数据主要来源于网页、书籍、官方媒体等。 我们使用规则+模型的方式进行了相关的过滤,并对数据进行了相似性去重,尽可能地提取出高质量地数据。 TeleChat-PTD 数据集大约公开了2.7亿条数据,数据由纯中文文本构成,原始大小约1TB,压缩后480G,共189个文件。数据集中已经去除了其它冗余信息。 数据下载 huggingface下载地址:数据下载 天翼云盘下载地址:数据下载(访问码:pkg8) 数据格式 数据为jsonl格式,仅有一个字段data: 单条处理后的预训练数据 数据清洗… See the full description on the dataset page: https://huggingface.co/datasets/Tele-AI/TeleChat-PTD.
| Author / organization | Tele-AI |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 1.2K (as reported by Hugging Face) |
| Likes | 181 |
| Created | 8 January 2024 |
| Last updated at source | 20 March 2024 |
More from Tele-AI
- Tele-AI/TELEVALDataset
- Tele-AI/TeleTableBenchDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.