12 results found Sort:

666DZY666
micronet 666DZY666
478
2.2k
mit
40
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
bnn twn onnx dorefa pruning pytorch tensorrt xnor-net quantization network-slimming group-convolution model-compression network-in-network tensorrt-int8-python convolutional-networks neuromorphic-computing integer-arithmetic-only batch-normalization-fuse post-training-quantization quantization-aware-training
Created 2019-12-04
295 commits to master branch, last one 2 years ago
intel
neural-compressor intel
248
2.1k
apache-2.0
34
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training
Created 2020-07-21
3,477 commits to master branch, last one 6 days ago
alibaba
TinyNeuralNetwork alibaba
119
724
mit
21
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
pruning pytorch deep-learning model-converter model-compression deep-neural-networks post-training-quantization quantization-aware-training
Created 2021-11-02
793 commits to main branch, last one 15 hours ago
SqueezeAILab
SqueezeLLM SqueezeAILab
38
593
mit
17
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
llm llama localllm transformer quantization small-models text-generation model-compression efficient-inference large-language-models post-training-quantization natural-language-processing
Created 2023-06-12
50 commits to main branch, last one 3 months ago
megvii-research
Sparsebit megvii-research
40
322
apache-2.0
12
A model compression and acceleration toolbox based on pytorch.
sparse pruning tensorrt quantization deep-learning post-training-quantization quantization-aware-training
Created 2022-07-21
134 commits to main branch, last one 11 months ago
megvii-research
FQ-ViT megvii-research
47
290
apache-2.0
5
[IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer
pytorch imagenet quantization vision-transformer post-training-quantization
Created 2021-11-24
20 commits to main branch, last one about a year ago
Xiuyu-Li
q-diffusion Xiuyu-Li
20
281
mit
17
[ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.
ddim pytorch quantization diffusion-models stable-diffusion model-compression post-training-quantization
Created 2023-03-24
12 commits to master branch, last one 3 months ago
sayakpaul
Adventures-in-TensorFlow-Lite sayakpaul
33
169
apache-2.0
12
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
tf-hub pruning inference on-device-ml tensorflow-2 tf-lite-model tensorflow-lite model-optimization model-quantization post-training-quantization quantization-aware-training
Created 2020-04-29
143 commits to master branch, last one about a year ago
ModelTC
llmc ModelTC
9
115
apache-2.0
8
This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and also an efficient LLM compression tool w...
awq llm opt ptq tool llama falcon llama2 llama3 pruning internlm benchmark internlm2 omniquant deployment evaluation smoothquant quantization large-language-models post-training-quantization
Created 2024-03-06
62 commits to main branch, last one a day ago
ModelTC
TFMQ-DM ModelTC
3
42
apache-2.0
10
[CVPR 2024 Highlight] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".
ldm cvpr ddim cvpr2024 highlight quantization diffusion-models stable-diffusion post-training-quantization
Created 2024-03-09
23 commits to main branch, last one 14 days ago
hkproj
quantization-notes hkproj
10
40
unknown
2
Notes on quantization in neural networks
pytorch quantization deep-learning neural-networks post-training-quantization quantization-aware-training
Created 2023-11-24
15 commits to main branch, last one 6 months ago
ModelTC
QLLM ModelTC
1
26
apache-2.0
8
[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"
llm llama llama2 pytorch quantization transformers post-training-quantization
Created 2024-02-21
9 commits to main branch, last one 3 months ago