GPT-NL Public Corpus: A Permissively Licensed, Dutch-First Dataset for LLM Pre-training
We present the GPT-NL Public Corpus, the biggest permissively licensed corpus of Dutch language resources. The GPT-NL Public Corpus contains 21 Dutch-only collections totalling 36B preprocessed Dutch tokens not present in any other LLM pretraining corpus. Additionally, the corpus includes roughly 207B English, 232B Code, and 48B German/Danish tokens taken from existing sets which we further curated for compliance. This corpus includes curated data from large existing corpora like Common Corpus and Common Crawl, as well as newly created Dutch-specific collections. Most newly created Dutch collections consist of content collected in collaboration with organisations or synthetically augmente...
| Authors | Jesse van Oort, Frank Brinkkemper, Erik de Graaf et al. |
|---|---|
| Primary category | cs.CL |
| Published | 1 April 2026 |
| Last updated at source | 1 April 2026 |
Popularity, last 3 days
0 now. Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- GPT-NL/GPT-NL_Public_CorpusDataset · cited by
Models and datasets referencing this paper
- GPT-NL/GPT-NL_Public_CorpusDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.