Search Results - RepositoryStats

257

2.2k

apache-2.0

33

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training

Created 2020-07-21

3,628 commits to master branch, last one 9 hours ago

LLaMA-Cult-and-More shm007g

24

427

mit

34

Large Language Models for All, 🦙 Cult and More, Stay in touch !

gpt llm ggml gpt4 gptq llama alpaca vicuna chatgpt loralib pytorch deepspeed tensorflow transformers

Created 2023-03-30

27 commits to main branch, last one about a year ago

xllm BobaZooba

21

382

apache-2.0

4

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

gpt llm gptq gpt-4 llama torch alpaca llama2 openai vicuna zephyr chatgpt mistral pytorch cerebras bitsandbytes deep-learning deep-neural-networks large-language-models

Created 2023-11-10

62 commits to main branch, last one 12 months ago

auto-round intel

23

263

apache-2.0

11

Advanced Quantization Algorithm for LLMs/VLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

awq gptq int4 rounding quantization neural-compressor

Created 2024-01-04

355 commits to main branch, last one 11 hours ago