Dataset · Hugging Face

m-a-p/Matrix

Name: Matrix
Creator: m-a-p
License: apache-2.0
Keywords: task_categories:text-generation, language:en, language:zh, license:apache-2.0, size_categories:1B<n<10B, format:json, modality:text, library:datasets, library:dask, library:mlcroissant, region:us, language model

Matrix An open-source pretraining dataset containing 4690 billion tokens, this bilingual dataset with both English and Chinese texts is used for training neo models. Dataset Composition The dataset consists of several components, each originating from different sources and serving various purposes in language modeling and processing. Below is a brief overview of each component: Common Crawl Extracts from the Common Crawl project, featuring a rich diversity of… See the full description on the dataset page: https://huggingface.co/datasets/m-a-p/Matrix.

View on Hugging FaceReport an issue

Author / organization	m-a-p
License (as declared)	apache-2.0
Downloads	31K (as reported by Hugging Face)
Likes	180
Created	8 May 2024
Last updated at source	25 February 2025

language model

Embed this entry

<iframe src="https://silytics.si/embed/item/1d7e6750-83d9-4d33-851a-e7a2ea621cc7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from m-a-p

m-a-p/FineFineWebDataset
m-a-p/PIN-200MDataset
m-a-p/CodeFeedback-Filtered-InstructionDataset
m-a-p/FineFineWeb-sampleDataset
m-a-p/PIN-14MDataset
m-a-p/GTZANDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.