princeton-nlp/prolong-data-512K
princeton-nlp/prolong-data-512K [Paper] [HF Collection] [Code] ProLong (Princeton long-context language models) is a family of long-context models that are continued trained and supervised fine-tuned from Llama-3-8B, with a maximum context window of 512K tokens. Our main ProLong model is one of the best-performing long-context models at the 10B scale (evaluated by HELMET). To train this strong long-context model, we conduct thorough ablations on the long-context pre-training… See the full description on the dataset page: https://huggingface.co/datasets/princeton-nlp/prolong-data-512K.
| Author / organization | princeton-nlp |
|---|---|
| Downloads | 3K (as reported by Hugging Face) |
| Likes | 15 |
| Created | 3 October 2024 |
| Last updated at source | 5 March 2025 |
Popularity, last 2 days
3,007 now (+61 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- mradermacher/Llama-3-8B-ProLong-512k-Base-i1-GGUFModel · used to train
- QuantFactory/Llama-3-8B-ProLong-512k-Base-GGUFModel · used to train
- mradermacher/Llama-3-8B-ProLong-512k-Base-GGUFModel · used to train
- princeton-nlp/Llama-3-8B-ProLong-512k-BaseModel · used to train
- princeton-nlp/Llama-3-8B-ProLong-512k-InstructModel · used to train
Recent changes
- 17 Oct 2026 Description: princeton-nlp/prolong-data-512K [Paper] [HF Collection] [Code] ProLong (Princeton long-context language models) is a family of long-context models that are continued trained and supervised fine-tuned from Llama-3-8B, with a maximum context → princeton-nlp/prolong-data-512K [Paper] [HF Collection] [Code] ProLong (Princeton long-context language models) is a family of long-context models that are continued trained and supervised fine-tuned from Llama-3-8B, with a maximum context
Changes detected by Silytics between refreshes of the source.
More from princeton-nlp
- princeton-nlp/SWE-bench_VerifiedDataset
- princeton-nlp/SWE-benchDataset
- princeton-nlp/SWE-bench_LiteDataset
- princeton-nlp/CharXivDataset
- princeton-nlp/SWE-bench_MultimodalDataset
- princeton-nlp/prolong-data-64KDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.