15 results found Sort:

intel
neural-compressor intel
257
2.2k
apache-2.0
33
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training
Created 2020-07-21
3,628 commits to master branch, last one 9 hours ago
666DZY666
micronet 666DZY666
478
2.2k
mit
41
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
bnn twn onnx dorefa pruning pytorch tensorrt xnor-net quantization network-slimming group-convolution model-compression network-in-network tensorrt-int8-python convolutional-networks neuromorphic-computing integer-arithmetic-only batch-normalization-fuse post-training-quantization quantization-aware-training
Created 2019-12-04
295 commits to master branch, last one 3 years ago
openvinotoolkit
nncf openvinotoolkit
237
951
apache-2.0
31
Neural Network Compression Framework for enhanced OpenVINO™ inference
llm nlp bert onnx genai pruning pytorch openvino sparsity tensorflow compression quantization transformers deep-learning classification object-detection semantic-segmentation mixed-precision-training quantization-aware-training
Created 2020-05-13
2,308 commits to develop branch, last one a day ago
alibaba
TinyNeuralNetwork alibaba
116
765
mit
21
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
pruning pytorch deep-learning model-converter model-compression deep-neural-networks post-training-quantization quantization-aware-training
Created 2021-11-02
818 commits to main branch, last one a day ago
SpursLipu
YOLOv3v4-ModelCompression-MultidatasetTraining-Multibackbone SpursLipu
136
445
gpl-3.0
8
YOLO ModelCompression MultidatasetTraining
yolo pruning mobilenetv3 multidataset modelcompression object-detection quantization-aware-training
Created 2019-12-24
438 commits to master branch, last one 2 years ago
megvii-research
Sparsebit megvii-research
40
328
apache-2.0
12
A model compression and acceleration toolbox based on pytorch.
sparse pruning tensorrt quantization deep-learning post-training-quantization quantization-aware-training
Created 2022-07-21
134 commits to main branch, last one about a year ago
fastmachinelearning
hls4ml-tutorial fastmachinelearning
138
305
unknown
18
Tutorial notebooks for hls4ml
fpga hls4ml pruning tutorial machine-learning quantization-aware-training
Created 2020-06-02
101 commits to main branch, last one 2 months ago
Beomi
BitNet-Transformers Beomi
33
284
unknown
9
0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture
llm quantization transformers quantization-aware-training
Created 2023-10-19
18 commits to main branch, last one about a year ago
THU-MIG
torch-model-compression THU-MIG
40
244
mit
12
针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库
qat onnx acnet pruning pytorch tensorrt quantization model-compression reparameterization tensorrt-conversion quantization-aware-training
Created 2021-06-04
49 commits to main branch, last one about a year ago
sayakpaul
Adventures-in-TensorFlow-Lite sayakpaul
34
171
apache-2.0
12
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
tf-hub pruning inference on-device-ml tensorflow-2 tf-lite-model tensorflow-lite model-optimization model-quantization post-training-quantization quantization-aware-training
Created 2020-04-29
143 commits to master branch, last one about a year ago
clovaai
frostnet clovaai
18
106
mit
7
FrostNet: Towards Quantization-Aware Network Architecture Search
pytorch optimizers quantization deep-learning classification style-transfer computer-vision object-detection int8-quantization post-quantization network-architecture semantic-segmentation quantization-aware-training quantization-efficient-network
Created 2020-06-17
36 commits to master branch, last one 3 years ago
jahongir7174
YOLOv8-qat jahongir7174
8
58
unknown
0
Quantization Aware Training
python yolov8 pytorch int8-inference object-detection int8-quantization quantization-aware-training
Created 2023-05-24
1 commits to master branch, last one about a year ago
hkproj
quantization-notes hkproj
15
58
unknown
2
Notes on quantization in neural networks
pytorch quantization deep-learning neural-networks post-training-quantization quantization-aware-training
Created 2023-11-24
15 commits to main branch, last one 11 months ago
mlzxy
qsparse mlzxy
2
40
mit
2
Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules
pruning pytorch neural-network model-compression quantization-aware-training
Created 2021-06-19
161 commits to main branch, last one 2 years ago
jeshraghian
QSNNs jeshraghian
5
36
other
3
Quantization-aware training with spiking neural networks
snn neural spiking networks neuroscience quantization deep-learning backpropagation spiking-neural-networks quantization-aware-training
Created 2022-01-03
8 commits to main branch, last one 2 years ago