Sign inGet started
Repository · GitHub

Tebmer/Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

OwnerTebmer
Stars1,316
Forks76
Main language—
Created8 February 2024
Last updated at source9 March 2025
alignmentcompressiondata-augmentationdata-synthesisfeedbackinstruction-followingkdknowledge-distillationlarge-language-modelllmmulti-modalself-distillationself-trainingsupervised-finetuningsurvey
Embed this entry
<iframe src="https://silytics.si/embed/item/7f47972f-9ddb-408d-a337-33ae7f77f5f7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.