Search Results - RepositoryStats

257

2.2k

apache-2.0

33

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training

Created 2020-07-21

3,619 commits to master branch, last one a day ago

sparseml neuralmagic

148

2.1k

apache-2.0

49

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

nlp onnx keras automl pruning pytorch sparsity tensorflow smaller-models sparsification object-detection transfer-learning pruning-algorithms deep-learning-models image-classification deep-learning-library sparsification-recipes deep-learning-algorithms computer-vision-algorithms

Created 2020-12-11

1,826 commits to main branch, last one 4 months ago

ao pytorch

177

1.6k

bsd-3-clause

41

PyTorch native quantization and sparsity for training and inference

mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization

Created 2023-11-03

776 commits to main branch, last one 13 hours ago

PaddleSlim PaddlePaddle

345

1.6k

apache-2.0

91

PaddleSlim is an open-source library for deep model compression and architecture search.

nas bert ernie yolov5 yolov6 yolov7 pruning sparsity tensorrt detection compression transformer distillation quantization segmentation

Created 2019-12-16

1,245 commits to develop branch, last one a day ago

model-optimization tensorflow

323

1.5k

apache-2.0

120

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

ml keras pruning sparsity tensorflow compression optimization quantization deep-learning machine-learning model-compression quantized-networks quantized-training quantized-neural-networks

Created 2018-10-31

833 commits to master branch, last one 17 days ago

nncf openvinotoolkit

234

943

apache-2.0

31

Neural Network Compression Framework for enhanced OpenVINO™ inference

nlp bert hawq onnx pruning pytorch openvino sparsity tensorflow compression mmdetection quantization transformers deep-learning classification object-detection semantic-segmentation mixed-precision-training quantization-aware-training

Created 2020-05-13

2,293 commits to develop branch, last one 21 hours ago

network-slimming Eric-mingjie

213

910

mit

14

Network Slimming (Pytorch) (ICCV 2017)

pytorch sparsity deep-learning channel-pruning convolutional-neural-networks

Created 2018-07-05

15 commits to master branch, last one 4 years ago

llm-compressor vllm-project

58

690

apache-2.0

12

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

sparsity compression quantization

Created 2024-06-20

2,098 commits to main branch, last one 8 hours ago

flexible-yolov5 Bobo-y

120

667

gpl-3.0

10

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt

gcn ptq qat cbam neck dcnv2 hrnet resnet yolov3 yolov5 pytorch backbone sparsity tensorrt moblienet shufflenet triton-server object-detection swin-transformer

Created 2021-03-26

206 commits to v2 branch, last one 3 months ago

H2O FMInference

42

391

unknown

5

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

gpt-3 kv-cache sparsity heavy-hitters high-throughput large-language-models

Created 2023-06-12

41 commits to main branch, last one 5 months ago

neural-speed intel

38

348

apache-2.0

8

An innovative library for efficient LLM inference via low-bit quantization

This repository has been archived (exclude archived)

Created 2023-11-20

345 commits to main branch, last one 2 months ago

sporco bwohlberg

37

262

bsd-3-clause

16

Sparse Optimisation Research Code

admm cuda fista python sparsity robust-pca optimization sparse-coding total-variation dictionary-learning plug-and-play-priors sparse-representations optimization-algorithms convolutional-sparse-coding total-variation-minimization convolutional-dictionary-learning

Created 2016-04-21

1,116 commits to master branch, last one 6 months ago

sparse-evolutionary-artificial-neural-networks dcmocanu

62

242

mit

23

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boos...

sparsity scalability deep-learning randomization classification neuroevolution sparse-training complex-networks generative-models deep-learning-papers deep-neural-networks multi-layer-perceptron scalable-deep-learning sparse-neural-networks evolutionary-algorithms deep-learning-algorithms artificial-neural-networks adaptive-sparse-connectivity restricted-boltzmann-machine sparse-evolutionary-training

Created 2018-03-02

26 commits to master branch, last one 3 years ago

SMSR The-Learning-And-Vision-Atelier-LAVA

30

237

unknown

7

[CVPR 2021] Exploring Sparsity in Image Super-Resolution for Efficient Inference

sparsity super-resolution efficient-inference

Created 2020-07-26

38 commits to master branch, last one 3 years ago

deep-compression jack-willturner

40

174

mit

4

Learning both Weights and Connections for Efficient Neural Networks https://arxiv.org/abs/1506.02626

pruning pytorch sparsity deep-learning

Created 2017-11-03

88 commits to master branch, last one 3 years ago

torchprune lucaslie

24

160

mit

5

A research library for pytorch-based neural network pruning, compression, and more.

tinyml pruning pytorch coresets sparsity compression deep-learning filter-pruning sparsification weight-pruning neural-networks machine-learning pruning-algorithms tensor-decomposition generalization-ability neural-architecture-search

Created 2020-02-14

12 commits to main branch, last one 2 years ago

clip-distillation NVIDIA-AI-IOT

15

114

other

7

Zero-label image classification via OpenCLIP knowledge distillation

qat clip jetson nvidia sparsity tensorrt inference knowledge distillation

Created 2023-06-27

17 commits to master branch, last one about a year ago

UPop sdc17

5

99

bsd-3-clause

5

[ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.

pruning sparsity framework structured weight-pruning image-captioning visual-reasoning model-compression vision-transformer multimodal-learning image-text-retrieval text-image-retrieval efficient-deep-learning visual-question-answering vision-language-transformer

Created 2023-05-27

146 commits to main branch, last one about a year ago

TEAL FasterDecoding

1

96

mit

4

This repository has no description...

llm sparsity llm-inference

Created 2024-08-28

20 commits to main branch, last one about a month ago

STR RAIVNLab

11

88

apache-2.0

7

Soft Threshold Weight Reparameterization for Learnable Sparsity

cnn str icml icml2020 imagenet sparsity icml-2020 soft-thresholding learnable-sparsity resource-efficient efficient-inference edge-machine-learning sparsity-optimization soft-threshold-reparameterization

Created 2020-04-11

53 commits to master branch, last one 3 years ago

OWL luuyin

8

51

mit

3

Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"

llm pruning sparsity largelanguagemodel

Created 2023-10-07

35 commits to main branch, last one 4 months ago

In-Time-Over-Parameterization Shiweiliuiiiiiii

6

46

unknown

2

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

sparsity deep-learning generalization sparse-training overparameterization over-parameterization dynamic-sparse-training in-time-overparameterization in-time-over-parameterization

Created 2021-06-10

70 commits to main branch, last one about a year ago

declipping2020_codes rajmic

11

44

gpl-3.0

5

Codes and data coming with article "A Survey and an Extensive Evaluation of Popular Audio Declipping Methods", and others closely related

audio sparsity crossfade algorithms declipping evaluation reproducible-research non-negative-matrix-factorization

Created 2020-06-04

20 commits to master branch, last one about a year ago

Why-the-State-of-Pruning-so-Confusing MingSun-Tse

1

40

unknown

5

[Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning

sparsity network-pruning model-compression efficient-deep-learning

Created 2022-12-11

20 commits to master branch, last one about a year ago

sconce satabios

2

39

mit

1

Model Compression/Inference Made Easy

torch pruning pytorch sparsity deployment quantization

Created 2023-07-21

583 commits to main branch, last one 2 months ago

Sparsity-Win-Robust-Generalization VITA-Group

2

37

mit

7

[ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun Wang*, Santosh Balachandra*, Haoyu Ma*, Zehao Wang, Zhangyang ...

pruning sparsity generalization robust-overfitting robust-generalization dynamic-sparse-training lottery-ticket-hypothesis

Created 2021-12-06

5 commits to main branch, last one 2 years ago

SparseConnectivityTracer.jl adrhill

2

28

mit

3

Fast operator-overloading Jacobian & Hessian sparsity detection.

julia hessian autodiff jacobian sparsity

Created 2024-03-28

160 commits to main branch, last one about a month ago

Iterative-Soft-Shrinkage-SR Jiamian-Wang

0

25

unknown

3

[ICCV2023 Official PyTorch code] for Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution

pruning sparsity efficiency weight-pruning super-resolution image-restoration

Created 2023-08-07

4 commits to main branch, last one 8 months ago