instruction-pretrain/ft-instruction-synthesizer-collection
Instruction Pre-Training: Language Models are Supervised Multitask Learners (EMNLP 2024) This repo contains the fine-tuning data collection for the context-based instruction synthesizer used in our paper Instruction Pre-Training: Language Models are Supervised Multitask Learners. We explore supervised multitask pre-training by proposing Instruction Pre-Training, a framework that scalably augments massive raw corpora with instruction-response pairs to pre-train language models.… See the full description on the dataset page: https://huggingface.co/datasets/instruction-pretrain/ft-instruction-syn
| Author / organization | instruction-pretrain |
|---|---|
| License (as declared) | other |
| Downloads | 641 (as reported by Hugging Face) |
| Likes | 63 |
| Created | 18 June 2024 |
| Last updated at source | 22 February 2026 |
Popularity, last 4 days
641 now (-51 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- QuantFactory/InstructLM-1.3B-GGUFModel · used to train
- mradermacher/instruction-synthesizer-GGUFModel · used to train
- QuantFactory/InstructLM-500M-GGUFModel · used to train
- instruction-pretrain/InstructLM-500MModel · used to train
- mradermacher/InstructLM-1.3B-i1-GGUFModel · used to train
- mradermacher/InstructLM-1.3B-GGUFModel · used to train
- mradermacher/InstructLM-500M-GGUFModel · used to train
- QuantFactory/instruction-synthesizer-GGUFModel · used to train
- mradermacher/instruction-synthesizer-i1-GGUFModel · used to train
- mradermacher/InstructLM-500M-i1-GGUFModel · used to train
- instruction-pretrain/InstructLM-1.3BModel · used to train
Recent changes
- 16 Oct 2026 Description: Instruction Pre-Training: Language Models are Supervised Multitask Learners (EMNLP 2024) This repo contains the fine-tuning data collection for the context-based instruction synthesizer used in our paper Instruction Pre-Training: Language M → Instruction Pre-Training: Language Models are Supervised Multitask Learners (EMNLP 2024) This repo contains the fine-tuning data collection for the context-based instruction synthesizer used in our paper Instruction Pre-Training: Language M
Changes detected by Silytics between refreshes of the source.
More from instruction-pretrain
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.