Tebmer / Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Date Created 2024-02-08 (about a year ago)

Commits 56 (last one 2 days ago)

Stargazers 906 (29 this week)

Watchers 15 (0 this week)

Forks 54

License unknown

Ranking

RepositoryStats indexes 625,486 repositories, of these Tebmer/Awesome-Knowledge-Distillation-of-LLMs is ranked #58,479 (91st percentile) for total stargazers, and #161,109 for total watchers.

Tebmer/Awesome-Knowledge-Distillation-of-LLMs is also tagged with popular topics, for these it's ranked: llm (#565/3418), compression (#68/460), knowledge-distillation (#19/167)

Other Information

Tebmer/Awesome-Knowledge-Distillation-of-LLMs has 1 open pull request on Github, 2 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there is 1 open issue and 5 closed issues.

All Topics

kd llm survey feedback alignment compression multi-modal self-training data-synthesis data-augmentation self-distillation large-language-model instruction-following supervised-finetuning knowledge-distillation

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

56 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

We don't have any language data for this repository

It's a mystery

updated: 2025-03-11 @ 05:44pm, id: 754706306 / R_kgDOLPvngg