2 results found Sort:
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
Created
2020-07-21
3,610 commits to master branch, last one a day ago
An innovative library for efficient LLM inference via low-bit quantization
This repository has been archived
(exclude archived)
Created
2023-11-20
345 commits to main branch, last one 2 months ago