Search Results - RepositoryStats

248

2.1k

apache-2.0

34

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training

Created 2020-07-21

3,480 commits to master branch, last one a day ago

LLaMA-Cult-and-More shm007g

24

422

mit

34

Large Language Models for All, 🦙 Cult and More, Stay in touch !

gpt llm ggml gpt4 gptq llama alpaca vicuna chatgpt loralib pytorch deepspeed tensorflow transformers

Created 2023-03-30

27 commits to main branch, last one about a year ago

xllm BobaZooba

21

359

apache-2.0

3

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

gpt llm gptq gpt-4 llama torch alpaca llama2 openai vicuna zephyr chatgpt mistral pytorch cerebras bitsandbytes deep-learning deep-neural-networks large-language-models

Created 2023-11-10

62 commits to main branch, last one 6 months ago

llm-api 1b5d

22

149

mit

3

Run any Large Language Model behind a unified API

llm gptq llama python chatgpt llamacpp langchain huggingface llm-inference machine-learning

Created 2023-04-02

31 commits to main branch, last one 7 months ago

ialacol chenhunghan

17

142

mit

3

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

ai gpu llm cuda ggml gptq helm openai python llamacpp langchain kubernetes cloudnative llm-serving llm-inference

This repository has been archived (exclude archived)

Created 2023-05-23

154 commits to main branch, last one 4 months ago

auto-round intel

16

105

apache-2.0

9

SOTA Weight-only Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

awq gptq int4 rounding weight-only quantization neural-compressor

Created 2024-01-04

208 commits to main branch, last one 2 days ago

gptq_for_langchain abhinand5

9

40

gpl-3.0

2

A guide about how to use GPTQ models with langchain

ai gpt llm gptq wizardlm langchain quantization language-model

Created 2023-05-11

8 commits to main branch, last one 10 months ago

zero-lora ziwang-com

3

30

unknown

1

zero零训练llm调参

gpt llm gptq lora llama

Created 2023-05-17

40 commits to main branch, last one 11 months ago