mittagessen/openiti_chunked
Description This dataset is derived from the 2023.1.8 release of the OpenITI corpus and is intended to pretrain small language models with short context lengths (<2048 Unicode code points). Processing The markdown files were converted into raw text by stripping all code points neither classified as whitespace nor found in the Arabic Unicode code pages. Each document was then chunked by randomly sampling sequences of 2048 character length with a number of samples… See the full description on the dataset page: https://huggingface.co/datasets/mittagessen/openiti_chunked.
| Author / organization | mittagessen |
|---|---|
| License (as declared) | cc0-1.0 |
| Downloads | 408 (as reported by Hugging Face) |
| Likes | 1 |
| Created | 16 June 2025 |
| Last updated at source | 16 June 2025 |
Popularity, last 3 days
408 now (-58 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 17 Oct 2026 Description: Description This dataset is derived from the 2023.1.8 release of the OpenITI corpus and is intended to pretrain small language models with short context lengths (<2048 Unicode code points). Processing The markdown files were converted into → Description This dataset is derived from the 2023.1.8 release of the OpenITI corpus and is intended to pretrain small language models with short context lengths (<2048 Unicode code points). Processing The markdown files were converted into
Changes detected by Silytics between refreshes of the source.
More from mittagessen
- mittagessen/openiti-2023.1.8Dataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.