Dataset · Hugging Face

jhu-clsp/ettin-decay-data

Name: ettin-decay-data
Creator: jhu-clsp
License: mit
Keywords: task_categories:text-generation, language:en, license:mit, arxiv:2507.11412, region:us, pretraining, language-modeling, encoder-decoder

Ettin Decay Phase Data Phase 3 of 3: Premium data sources for final training phase (100B tokens) following the ProLong recipe. This dataset contains the decay phase data used to train all Ettin encoder and decoder models. This final phase uses premium data sources with emphasis on long-form content and educational materials. The data is provided in MDS format ready for use with Composer and the ModernBERT training repository. Abstract The large language… See the full description on the dataset page: https://huggingface.co/datasets/jhu-clsp/ettin-decay-data.

View on Hugging FaceReport an issue

Author / organization	jhu-clsp
License (as declared)	mit
Downloads	841 (as reported by Hugging Face)
Likes	1
Created	18 January 2025
Last updated at source	18 July 2025

pretraininglanguage-modelingencoder-decoder

Embed this entry

<iframe src="https://silytics.si/embed/item/69d34d45-ee1c-4ff0-8f93-88e0067b55e2" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

841 now (+99 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

jhu-clsp/ettin-decoder-400mModel · used to train

Explore this entry in the graph

Recent changes

16 Oct 2026 Description: Ettin Decay Phase Data Phase 3 of 3: Premium data sources for final training phase (100B tokens) following the ProLong recipe. This dataset contains the decay phase data used to train all Ettin encoder and decoder models. This final phase u → Ettin Decay Phase Data Phase 3 of 3: Premium data sources for final training phase (100B tokens) following the ProLong recipe. This dataset contains the decay phase data used to train all Ettin encoder and decoder models. This final phase u

Changes detected by Silytics between refreshes of the source.

More from jhu-clsp

jhu-clsp/mmBERT-midtraining-dataDataset
jhu-clsp/ettin-pretraining-dataDataset
jhu-clsp/mmBERT-decay-dataDataset
jhu-clsp/megawika-2Dataset
jhu-clsp/core17-instructions-mtebDataset
jhu-clsp/jflegDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.