Awesome Knowledge Distillation Of LLMs

ai_model

Tebmer/Awesome-Knowledge-Distillation-of-LLMs is an open source AI ai_model. This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs. Built with multiple languages, 1,271 GitHub stars.