Dataset · Hugging Face

prismdata/Perdix-Pretrain-Data

Name: Perdix-Pretrain-Data
Creator: prismdata
License: odc-by
Keywords: task_categories:text-generation, language:ko, language:en, license:odc-by, license:cc-by-4.0, size_categories:10M<n<100M, format:parquet, modality:tabular, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, pretraining

Perdix-Pretrain-Data Perdix-1.1B-Base 사전학습에 쓴 원본 데이터를 그대로 모아 둔 것입니다. 새로 만든 데이터는 없고, 아래 세 공개 데이터셋에서 실제로 쓴 parquet 파일만 골라 복사했습니다. 어떤 파일을 어떤 비율로 썼는지 남겨 두려는 목적입니다. The exact subset of three public datasets (DCLM-baseline, FineWeb2 kor_Hang, FineMath 4+) used to pretrain Perdix-1.1B-Base. Files are unmodified copies; this repository only records which shards were used. 335 parquet files, about 89.7M documents, 178 GB. 구성 폴더 원 데이터셋 파일 문서 수 크기 토큰 수* 라이선스… See the full description on the dataset page: https://huggingface.co/datasets/prismdata/Perdix-Pretrain-Data.

View on Hugging FaceReport an issue

Author / organization	prismdata
License (as declared)	odc-by
Downloads	154 (as reported by Hugging Face)
Likes	0
Created	6 October 2026
Last updated at source	6 October 2026

pretrainingwebmathkorean

Embed this entry

<iframe src="https://silytics.si/embed/item/8a165ff3-d004-42fd-8dd3-c57e24c7cf27" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.