Tebmer / Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Date Created 2024-02-08 (9 months ago)

Commits 52 (last one about a month ago)

Stargazers 656 (8 this week)

Watchers 11 (0 this week)

Forks 39

License unknown

Ranking

RepositoryStats indexes 584,353 repositories, of these Tebmer/Awesome-Knowledge-Distillation-of-LLMs is ranked #73,663 (87th percentile) for total stargazers, and #191,111 for total watchers.

Tebmer/Awesome-Knowledge-Distillation-of-LLMs is also tagged with popular topics, for these it's ranked: llm (#549/2726), compression (#82/444), knowledge-distillation (#22/157)

Other Information

Tebmer/Awesome-Knowledge-Distillation-of-LLMs has 1 open pull request on Github, 2 pull requests have been merged over the lifetime of the repository.

All Topics

kd llm survey feedback alignment compression multi-modal self-training data-synthesis data-augmentation self-distillation large-language-model instruction-following supervised-finetuning knowledge-distillation

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

52 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

We don't have any language data for this repository

It's a mystery

updated: 2024-11-20 @ 04:51pm, id: 754706306 / R_kgDOLPvngg