Search Results - RepositoryStats

483

3.3k

apache-2.0

114

Awesome Knowledge Distillation

kd co-training distillation deep-learning teacher-student model-compression distillation-model knowledge-transfer model-distillation knowldge-distillation knowledge-distillation

Created 2017-02-28

148 commits to master branch, last one 8 days ago

Awesome-Knowledge-Distillation FLHonker

334

2.4k

unknown

61

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

kd distillation deep-learning model-compression transfer-learning knowldge-distillation

Created 2019-10-17

349 commits to main branch, last one about a year ago

Knowledge-Distillation-Zoo AberHu

262

1.5k

unknown

23

Pytorch implementation of various Knowledge Distillation (KD) methods.

kd kd-methods distillation teacher-student model-compression knowledge-transfer knowledge-distillation

Created 2019-02-15

65 commits to master branch, last one 2 years ago

SimpleAICV_pytorch_training_examples zgcr

95

404

mit

9

SimpleAICV:pytorch training and testing examples.

kd mae sam vit dino fcos u2net repvgg resnet solov2 ttfnet yolact darknet pytorch regnetx centernet retinanet deeplabv3plus segment-anything

Created 2020-05-31

75 commits to master branch, last one 14 days ago

Awesome-Knowledge-Distillation-of-LLMs Tebmer

20

305

unknown

4

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vert...

kd llm survey feedback alignment compression multi-modal self-training data-synthesis data-augmentation self-distillation large-language-model instruction-following supervised-finetuning knowledge-distillation

Created 2024-02-08

47 commits to main branch, last one about a month ago

DIST_KD hunto

16

123

apache-2.0

2

Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022

kd dist pytorch imagenet detection

Created 2022-05-21

19 commits to main branch, last one about a year ago

KnowledgeFactor Adamdad

5

80

apache-2.0

2

[ECCV2022] Factorizing Knowledge in Neural Networks

kd pytorch eccv2022 distillation deep-learning knowledge-transfer multitask-learning knowldge-distillation

Created 2022-06-27

91 commits to main branch, last one about a year ago

image_classification_sota hunto

10

68

apache-2.0

3

Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.

kd nas rep vit cifar pruning pytorch imagenet transformer image-classification

Created 2022-03-11

39 commits to main branch, last one 2 months ago

mgd kaiyuyue

13

64

mit

5

Matching Guided Distillation (ECCV 2020)

kd mgd moco-v2 pytorch detection detectron2 deep-learning classification model-distillation unsupervised-learning knowledge-distillation matching-guided-distillation

Created 2020-08-23

23 commits to master branch, last one 2 years ago

MasKD hunto

5

58

apache-2.0

1

Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.

kd maskd pytorch detection segmentation

Created 2022-05-27

20 commits to main branch, last one about a year ago

Awesome-3D-Anomaly-Detection JerryX1110

8

57

mit

4

Awesome-3D/Multimodal-Anomaly-Detection-and-Localization/Segmentation/3D-KD/3D-knowledge-distillation

3d kd 3d-ad 3d-ads dataset depth-map detection multimodal point-cloud segmentation deep-learning anomaly-detection knowledge-distillation multimodal-anomaly-detection

Created 2021-12-23

17 commits to main branch, last one about a year ago