Search Results - RepositoryStats

258

2.3k

apache-2.0

33

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training

Created 2020-07-21

3,707 commits to master branch, last one 3 days ago

sparseml neuralmagic

149

2.1k

apache-2.0

49

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

nlp onnx keras automl pruning pytorch sparsity tensorflow smaller-models sparsification object-detection transfer-learning pruning-algorithms deep-learning-models image-classification deep-learning-library sparsification-recipes deep-learning-algorithms computer-vision-algorithms

Created 2020-12-11

1,826 commits to main branch, last one 6 months ago

ao pytorch

188

1.7k

bsd-3-clause

43

PyTorch native quantization and sparsity for training and inference

mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization

Created 2023-11-03

869 commits to main branch, last one 6 hours ago

PaddleSlim PaddlePaddle

349

1.6k

apache-2.0

91

PaddleSlim is an open-source library for deep model compression and architecture search.

nas bert ernie yolov5 yolov6 yolov7 pruning sparsity tensorrt detection compression transformer distillation quantization segmentation

Created 2019-12-16

1,246 commits to develop branch, last one 26 days ago

model-optimization tensorflow

324

1.5k

apache-2.0

120

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

ml keras pruning sparsity tensorflow compression optimization quantization deep-learning machine-learning model-compression quantized-networks quantized-training quantized-neural-networks

Created 2018-10-31

834 commits to master branch, last one 14 days ago

nncf openvinotoolkit

240

962

apache-2.0

31

Neural Network Compression Framework for enhanced OpenVINO™ inference

llm nlp bert onnx genai pruning pytorch openvino sparsity tensorflow compression quantization transformers deep-learning classification object-detection semantic-segmentation mixed-precision-training quantization-aware-training

Created 2020-05-13

2,343 commits to develop branch, last one 4 days ago

network-slimming Eric-mingjie

212

913

mit

14

Network Slimming (Pytorch) (ICCV 2017)

pytorch sparsity deep-learning channel-pruning convolutional-neural-networks

Created 2018-07-05

15 commits to master branch, last one 4 years ago

llm-compressor vllm-project

69

821

apache-2.0

15

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

sparsity compression quantization

Created 2024-06-20

2,126 commits to main branch, last one a day ago

flexible-yolov5 Bobo-y

119

670

gpl-3.0

11

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt

gcn ptq qat cbam neck dcnv2 hrnet resnet yolov3 yolov5 pytorch backbone sparsity tensorrt moblienet shufflenet triton-server object-detection swin-transformer

Created 2021-03-26

206 commits to v2 branch, last one 4 months ago

H2O FMInference

51

413

unknown

5

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

gpt-3 kv-cache sparsity heavy-hitters high-throughput large-language-models

Created 2023-06-12

41 commits to main branch, last one 6 months ago

neural-speed intel

38

351

apache-2.0

8

An innovative library for efficient LLM inference via low-bit quantization

This repository has been archived (exclude archived)

Created 2023-11-20

345 commits to main branch, last one 4 months ago

sporco bwohlberg

37

263

bsd-3-clause

16

Sparse Optimisation Research Code

admm cuda fista python sparsity robust-pca optimization sparse-coding total-variation dictionary-learning plug-and-play-priors sparse-representations optimization-algorithms convolutional-sparse-coding total-variation-minimization convolutional-dictionary-learning

Created 2016-04-21

1,116 commits to master branch, last one 8 months ago

sparse-evolutionary-artificial-neural-networks dcmocanu

63

247

mit

23

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boos...

sparsity scalability deep-learning randomization classification neuroevolution sparse-training complex-networks generative-models deep-learning-papers deep-neural-networks multi-layer-perceptron scalable-deep-learning sparse-neural-networks evolutionary-algorithms deep-learning-algorithms artificial-neural-networks adaptive-sparse-connectivity restricted-boltzmann-machine sparse-evolutionary-training

Created 2018-03-02

26 commits to master branch, last one 3 years ago

SMSR The-Learning-And-Vision-Atelier-LAVA

30

238

unknown

7

[CVPR 2021] Exploring Sparsity in Image Super-Resolution for Efficient Inference

sparsity super-resolution efficient-inference

Created 2020-07-26

38 commits to master branch, last one 3 years ago

deep-compression jack-willturner

38

176

mit

4

Learning both Weights and Connections for Efficient Neural Networks https://arxiv.org/abs/1506.02626

pruning pytorch sparsity deep-learning

Created 2017-11-03

88 commits to master branch, last one 3 years ago

torchprune lucaslie

24

160

mit

5

A research library for pytorch-based neural network pruning, compression, and more.

tinyml pruning pytorch coresets sparsity compression deep-learning filter-pruning sparsification weight-pruning neural-networks machine-learning pruning-algorithms tensor-decomposition generalization-ability neural-architecture-search

Created 2020-02-14

12 commits to main branch, last one 2 years ago

clip-distillation NVIDIA-AI-IOT

15

118

other

7

Zero-label image classification via OpenCLIP knowledge distillation

qat clip jetson nvidia sparsity tensorrt inference knowledge distillation

Created 2023-06-27

17 commits to master branch, last one about a year ago

TEAL FasterDecoding

1

102

mit

3

This repository has no description...

llm sparsity llm-inference

Created 2024-08-28

20 commits to main branch, last one 3 months ago

STR RAIVNLab

11

88

apache-2.0

7

Soft Threshold Weight Reparameterization for Learnable Sparsity

cnn str icml icml2020 imagenet sparsity icml-2020 soft-thresholding learnable-sparsity resource-efficient efficient-inference edge-machine-learning sparsity-optimization soft-threshold-reparameterization

Created 2020-04-11

53 commits to master branch, last one 3 years ago

LLaMA-MoE-v2 OpenSparseLLMs

8

64

apache-2.0

2

🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

moe sft llama llama3 sparsity attention fine-tuning instruction-tuning mixture-of-experts

Created 2024-11-26

272 commits to main branch, last one 27 days ago

OWL luuyin

8

53

mit

2

Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"

llm pruning sparsity largelanguagemodel

Created 2023-10-07

35 commits to main branch, last one 6 months ago

In-Time-Over-Parameterization Shiweiliuiiiiiii

6

47

unknown

2

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

sparsity deep-learning generalization sparse-training overparameterization over-parameterization dynamic-sparse-training in-time-overparameterization in-time-over-parameterization

Created 2021-06-10

70 commits to main branch, last one about a year ago

declipping2020_codes rajmic

11

47

gpl-3.0

5

Codes and data coming with article "A Survey and an Extensive Evaluation of Popular Audio Declipping Methods", and others closely related

audio sparsity crossfade algorithms declipping evaluation reproducible-research non-negative-matrix-factorization

Created 2020-06-04

20 commits to master branch, last one about a year ago

sconce satabios

2

42

mit

1

E2E AutoML Model Compression Package

torch pruning pytorch sparsity deployment quantization

Created 2023-07-21

605 commits to main branch, last one 10 days ago

Why-the-State-of-Pruning-so-Confusing MingSun-Tse

1

40

unknown

5

[Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning

sparsity network-pruning model-compression efficient-deep-learning

Created 2022-12-11

20 commits to master branch, last one about a year ago

Sparsity-Win-Robust-Generalization VITA-Group

2

39

mit

7

[ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun Wang*, Santosh Balachandra*, Haoyu Ma*, Zehao Wang, Zhangyang ...

pruning sparsity generalization robust-overfitting robust-generalization dynamic-sparse-training lottery-ticket-hypothesis

Created 2021-12-06

5 commits to main branch, last one 2 years ago

SparseConnectivityTracer.jl adrhill

3

30

mit

3

Fast operator-overloading Jacobian & Hessian sparsity detection.

julia hessian autodiff jacobian sparsity

Created 2024-03-28

163 commits to main branch, last one 13 days ago

Iterative-Soft-Shrinkage-SR Jiamian-Wang

0

26

unknown

3

[ICCV2023 Official PyTorch code] for Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution

pruning sparsity efficiency weight-pruning super-resolution image-restoration

Created 2023-08-07

4 commits to main branch, last one 9 months ago