63 results found Sort:

IntelLabs
distiller IntelLabs
801
4.4k
apache-2.0
132
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
onnx pruning pytorch early-exit group-lasso distillation quantization truncated-svd regularization jupyter-notebook pruning-structures network-compression deep-neural-networks automl-for-compression
This repository has been archived (exclude archived)
Created 2018-04-24
643 commits to master branch, last one about a year ago
dkozlov
awesome-knowledge-distillation dkozlov
495
3.5k
apache-2.0
113
Awesome Knowledge Distillation
kd co-training distillation deep-learning teacher-student model-compression distillation-model knowledge-transfer model-distillation knowldge-distillation knowledge-distillation
Created 2017-02-28
157 commits to master branch, last one about a month ago
FLHonker
Awesome-Knowledge-Distillation FLHonker
337
2.5k
unknown
61
Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
kd distillation deep-learning model-compression transfer-learning knowldge-distillation
Created 2019-10-17
349 commits to main branch, last one about a year ago
AberHu
Knowledge-Distillation-Zoo AberHu
269
1.6k
unknown
23
Pytorch implementation of various Knowledge Distillation (KD) methods.
kd kd-methods distillation teacher-student model-compression knowledge-transfer knowledge-distillation
Created 2019-02-15
65 commits to master branch, last one 2 years ago
airaria
TextBrewer airaria
239
1.6k
apache-2.0
27
A PyTorch-based knowledge distillation toolkit for natural language processing
nlp bert pytorch knowledge distillation
Created 2020-02-25
147 commits to master branch, last one about a year ago
GMvandeVen
continual-learning GMvandeVen
312
1.6k
mit
28
PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.
icarl replay distillation deep-learning generative-models lifelong-learning continual-learning incremental-learning replay-through-feedback variational-autoencoder gradient-episodic-memory task-incremental-learning artificial-neural-networks class-incremental-learning domain-incremental-learning elastic-weight-consolidation
Created 2018-09-26
41 commits to master branch, last one 8 months ago
PaddlePaddle
PaddleSlim PaddlePaddle
345
1.6k
apache-2.0
91
PaddleSlim is an open-source library for deep model compression and architecture search.
nas bert ernie yolov5 yolov6 yolov7 pruning sparsity tensorrt detection compression transformer distillation quantization segmentation
Created 2019-12-16
1,245 commits to develop branch, last one a day ago
ViTAE-Transformer
ViTPose ViTAE-Transformer
187
1.4k
apache-2.0
20
The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"
mae pytorch distillation deep-learning pose-estimation vision-transformer self-supervised-learning
Created 2022-04-27
19 commits to main branch, last one about a year ago
tangxyw
RecSysPapers tangxyw
201
1.4k
bsd-2-clause
57
推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.
rank match debias papers diverse re-rank fairness pre-rank cold-start look-alike multi-task calibration multi-modal distillation feedback-delay multi-scenario causal-inference contrastive-learning recommendation-system reinforcement-learning
Created 2022-08-16
173 commits to main branch, last one a day ago
Syencil
mobile-yolov5-pruning-distillation Syencil
163
825
mit
9
mobilev2-yolov5s剪枝、蒸馏，支持ncnn，tensorRT部署。ultra-light but better performence！
ncnn yolov5 pruning distillation mobile-yolov5s
Created 2020-09-07
17 commits to master branch, last one 3 years ago
szq0214
MEAL-V2 szq0214
69
693
unknown
18
MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.
meal pytorch imagenet resnet50 mobilenetv3 pre-trained distillation efficientnet imagenet-dataset distillation-model model-architecture compression-algorithm
Created 2020-08-25
25 commits to master branch, last one 2 years ago
Tanuki
tanuki.py Tanuki
24
674
mit
7
Prompt engineering for developers
ai llm tdd gpt-4 python tanuki chat-gpt pydantic alignment gpt-4-api ai-functions distillation
Created 2023-10-16
151 commits to master branch, last one 9 months ago
segmind
distill-sd segmind
36
572
other
17
Segmind Distilled diffusion
inference distillation stable-diffusion knowledge-distillation
Created 2023-07-21
73 commits to master branch, last one about a year ago
thu-ml
ares thu-ml
88
485
apache-2.0
17
A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.
bim hgd nes pca fgsm spsa mmlda mi-fgsm boundary deepfool distillation evolutionary adversarial-attacks benchmark-framework adversarial-robustness adversarial-machine-learning
Created 2020-03-19
190 commits to main branch, last one about a year ago
anarchy-ai
LLM-VM anarchy-ai
145
482
mit
12
irresponsible innovation. Try now at https://chat.dev/
llm llm-agent llm-local distillation llm-training deep-learning llm-inference machine-learning distillation-model artificial-intelligence
Created 2023-05-19
503 commits to main branch, last one 6 months ago
gojasper
flash-diffusion gojasper
33
474
other
10
Official implementation of ⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation
dit sdxl inpainting distillation text-to-image diffusion-models super-resolution
Created 2024-06-04
10 commits to main branch, last one 4 months ago
Zhen-Dong
HAWQ Zhen-Dong
82
413
mit
14
Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.
tvm 4-bit 8-bit hessian pytorch tensorcore distillation quantization hardware-aware mixed-precision model-compression efficient-neural-networks quantized-neural-networks
Created 2020-11-24
48 commits to main branch, last one about a year ago
huggingface
optimum-intel huggingface
112
410
apache-2.0
38
🤗 Optimum Intel: Accelerate inference with Intel optimization tools
onnx intel pruning openvino diffusers inference distillation optimization quantization transformers
Created 2022-05-25
942 commits to main branch, last one 20 hours ago
dotchen
LAV dotchen
69
406
apache-2.0
12
(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.
cvpr2022 planning perception prediction distillation carla-simulator autonomous-driving imitation-learning
Created 2022-02-14
8 commits to main branch, last one 2 years ago
gyunggyung
AGI-Papers gyunggyung
42
268
mit
10
Papers and Book to look at when starting AGI 📚
llm nlg nlp tts dialogue efficient all-to-all multimodal distillation text-to-video multiple-tasks stable-diffusion sentence-embeddings sentence-similarity
Created 2019-12-10
304 commits to master branch, last one 2 months ago
Nota-NetsPresso
BK-SDM Nota-NetsPresso
17
257
other
11
A Compressed Stable Diffusion for Efficient Text-to-Image Generation [ECCV'24]
pytorch compression huggingface lightweight distillation stable-diffusion
Created 2023-07-18
67 commits to main branch, last one 4 months ago
leondgarse
Keras_insightface leondgarse
56
240
mit
6
Insightface Keras implementation
tf keras arcface magface triplet ghostnet vargface tensorflow insightface tensorflow2 distillation efficientnet curricularface subcenter-arcface
Created 2019-12-21
347 commits to master branch, last one 6 months ago
GMvandeVen
brain-inspired-replay GMvandeVen
64
227
mit
7
A brain-inspired version of generative replay for continual learning with deep neural networks (e.g., class-incremental learning on CIFAR-100; PyTorch code).
replay split-mnist distillation deep-learning brain-inspired permuted-mnist split-cifar100 internal-replay generative-replay lifelong-learning continual-learning incremental-learning synaptic-intelligence replay-through-feedback variational-autoencoder artificial-neural-networks elastic-weight-consolidation
Created 2020-08-04
10 commits to master branch, last one 3 years ago
sinanuozdemir
quick-start-guide-to-llms sinanuozdemir
112
216
unknown
10
The Official Repo for "Quick Start Guide to Large Language Models"
ai gpt llm nlp rag bert multimodal distillation quantization generative-ai machine-learning
Created 2023-06-08
40 commits to main branch, last one about a month ago
HoyTta0
KnowledgeDistillation HoyTta0
54
213
apache-2.0
2
Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
bert pytorch distillation model-compression knowledge-distillation
Created 2020-05-19
33 commits to master branch, last one 2 years ago
Sharpiless
Yolov5-distillation-train-inference Sharpiless
32
208
gpl-3.0
2
Yolov5 distillation training | Yolov5知识蒸馏训练，支持训练自己的数据
yolov5 distillation object-detection model-compression konwledge-distillation
Created 2021-05-07
95 commits to main branch, last one 3 years ago
snap-research
R2L snap-research
23
191
other
15
[ECCV 2022] R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis
mlp nerf rendering distillation deep-learning neural-light-field novel-view-synthesis
Created 2022-03-09
6 commits to main branch, last one about a year ago
monologg
DistilKoBERT monologg
25
187
apache-2.0
6
Distillation of KoBERT from SKTBrain (Lightweight KoBERT)
bert kobert pytorch korean-nlp lightweight distillation transformers
Created 2019-11-23
106 commits to master branch, last one 3 years ago
szq0214
FKD szq0214
31
181
mit
8
Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
pytorch distillation deep-learning efficient-training efficient-algorithm efficientnet-pytorch knowledge-distillation self-supervised-learning
Created 2021-12-03
28 commits to main branch, last one 6 months ago
BioSTEAMDevelopmentGroup
biosteam BioSTEAMDevelopmentGroup
35
179
other
15
The Biorefinery Simulation and Techno-Economic Analysis Modules; Life Cycle Assessment; Chemical Process Simulation Under Uncertainty
pump flash reactor bioprocess centrifuge biorefinery monte-carlo distillation fermentation heat-exchanger thermodynamics unit-operation process-simulation biochemical-process chemical-engineering sensitivity-analysis life-cycle-assessment techno-economic-analysis
Created 2019-01-08
2,575 commits to master branch, last one 14 hours ago