Search Results - RepositoryStats

494

3.5k

apache-2.0

113

Awesome Knowledge Distillation

kd co-training distillation deep-learning teacher-student model-compression distillation-model knowledge-transfer model-distillation knowldge-distillation knowledge-distillation

Created 2017-02-28

159 commits to master branch, last one 6 days ago

Awesome-Knowledge-Distillation FLHonker

336

2.5k

unknown

61

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

kd distillation deep-learning model-compression transfer-learning knowldge-distillation

Created 2019-10-17

349 commits to main branch, last one about a year ago

Knowledge-Distillation-Zoo AberHu

270

1.6k

unknown

23

Pytorch implementation of various Knowledge Distillation (KD) methods.

kd kd-methods distillation teacher-student model-compression knowledge-transfer knowledge-distillation

Created 2019-02-15

65 commits to master branch, last one 3 years ago

Awesome-Knowledge-Distillation-of-LLMs Tebmer

40

669

unknown

11

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vert...

kd llm survey feedback alignment compression multi-modal self-training data-synthesis data-augmentation self-distillation large-language-model instruction-following supervised-finetuning knowledge-distillation

Created 2024-02-08

52 commits to main branch, last one about a month ago

SimpleAICV_pytorch_training_examples zgcr

95

422

mit

9

SimpleAICV:pytorch training and testing examples.

kd mae sam vit dino fcos u2net repvgg resnet solov2 ttfnet yolact darknet pytorch regnetx centernet retinanet deeplabv3plus segment-anything

Created 2020-05-31

89 commits to master branch, last one 8 days ago

awesome-compression datawhalechina

29

210

unknown

3

模型压缩的小白入门教程

kd prune tinyml compression quantization model-pruning model-compression model-quantization knowledge-distillation neural-architecture-search

Created 2023-12-28

136 commits to main branch, last one 14 days ago

DIST_KD hunto

20

138

apache-2.0

2

Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022

kd dist pytorch imagenet detection

Created 2022-05-21

19 commits to main branch, last one about a year ago

KnowledgeFactor Adamdad

5

89

apache-2.0

2

[ECCV2022] Factorizing Knowledge in Neural Networks

kd pytorch eccv2022 distillation deep-learning knowledge-transfer multitask-learning knowldge-distillation

Created 2022-06-27

91 commits to main branch, last one 2 years ago

image_classification_sota hunto

14

81

apache-2.0

4

Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.

kd nas rep vit cifar pruning pytorch imagenet transformer image-classification

Created 2022-03-11

39 commits to main branch, last one 8 months ago

Awesome-3D-Anomaly-Detection JerryX1110

11

69

mit

4

Awesome-3D/Multimodal-Anomaly-Detection-and-Localization/Segmentation/3D-KD/3D-knowledge-distillation

3d kd 3d-ad 3d-ads dataset depth-map detection multimodal point-cloud segmentation deep-learning anomaly-detection knowledge-distillation multimodal-anomaly-detection

Created 2021-12-23

17 commits to main branch, last one about a year ago

MasKD hunto

5

65

apache-2.0

1

Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.

kd maskd pytorch detection segmentation

Created 2022-05-27

20 commits to main branch, last one about a year ago

mgd kaiyuyue

13

64

mit

5

Matching Guided Distillation (ECCV 2020)

kd mgd moco-v2 pytorch detection detectron2 deep-learning classification model-distillation unsupervised-learning knowledge-distillation matching-guided-distillation

Created 2020-08-23

23 commits to master branch, last one 3 years ago

Rotated-LD Zzh-tju

2

43

apache-2.0

2

Rotated Localization Distillation (CVPR 2022, TPAMI 2023)

kd ld object-detection knowledge-distillation

Created 2022-04-13

68 commits to main branch, last one 11 months ago