148 results found Sort:

hiyouga
LLaMA-Factory hiyouga
4.5k
36.5k
apache-2.0
218
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,482 commits to main branch, last one 2 days ago
ymcui
Chinese-LLaMA-Alpaca ymcui
1.9k
18.5k
apache-2.0
184
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm nlp plm lora llama alpaca llama-2 alpaca-2 quantization large-language-models pre-trained-language-models
Created 2023-03-15
556 commits to main branch, last one 7 months ago
SYSTRAN
faster-whisper SYSTRAN
1.1k
13.1k
mit
124
Faster Whisper transcription with CTranslate2
openai whisper inference transformer quantization deep-learning speech-to-text speech-recognition
Created 2023-02-11
242 commits to master branch, last one 9 days ago
UFund-Me
Qbot UFund-Me
1.2k
8.4k
mit
109
[🔥updating ...] AI 自动量化交易机器人(完全本地部署) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant
qlib funds bitcoin fintech pytrade trade-bot blockchain strategies trademarks quant-trade quant-trader quantization deep-learning machine-learning quantitative-finance quantitative-trading
Created 2022-11-23
143 commits to main branch, last one about a month ago
kornelski
pngquant kornelski
487
5.3k
other
131
Lossy PNG compressor — pngquant command based on libimagequant library
c png stdin palette quality smaller pngquant conversion quantization png-compression image-optimization
Created 2009-09-17
1,206 commits to main branch, last one 5 months ago
AutoGPTQ
AutoGPTQ AutoGPTQ
491
4.6k
mit
31
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
nlp llms pytorch inference transformer quantization transformers deep-learning large-language-models
Created 2023-04-13
764 commits to main branch, last one 6 days ago
IntelLabs
distiller IntelLabs
801
4.4k
apache-2.0
132
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
onnx pruning pytorch early-exit group-lasso distillation quantization truncated-svd regularization jupyter-notebook pruning-structures network-compression deep-neural-networks automl-for-compression
This repository has been archived (exclude archived)
Created 2018-04-24
643 commits to master branch, last one about a year ago
OpenNMT
CTranslate2 OpenNMT
309
3.5k
mit
60
Fast inference engine for Transformer models
avx cpp mkl avx2 cuda gemm neon onednn openmp thrust opennmt inference intrinsics quantization deep-learning parallel-computing transformer-models machine-translation deep-neural-networks neural-machine-translation
Created 2019-09-23
2,189 commits to master branch, last one 3 days ago
neuralmagic
deepsparse neuralmagic
176
3.1k
other
58
Sparsity-aware deep learning inference runtime for CPUs
nlp cpus onnx pruning inference deepsparse performance quantization llm-inference sparsification computer-vision machinelearning object-detection pretrained-models
Created 2020-12-14
1,052 commits to main branch, last one 5 months ago
huawei-noah
Pretrained-Language-Model huawei-noah
628
3.0k
unknown
57
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
quantization model-compression pretrained-models knowledge-distillation large-scale-distributed
Created 2019-12-02
162 commits to master branch, last one 11 months ago
IntelLabs
nlp-architect IntelLabs
448
2.9k
apache-2.0
164
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
nlp nlu bert dynet pytorch tensorflow deeplearning quantization transformers deep-learning
This repository has been archived (exclude archived)
Created 2018-05-17
957 commits to master branch, last one 2 years ago
aaron-xichen
pytorch-playground aaron-xichen
615
2.6k
mit
53
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
pytorch quantization pytorch-tutorial pytorch-tutorials
Created 2017-04-28
17 commits to master branch, last one 4 years ago
huggingface
optimum huggingface
486
2.6k
apache-2.0
57
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
onnx intel habana tflite pytorch training graphcore inference onnxruntime optimization quantization transformers
Created 2021-07-20
1,152 commits to main branch, last one a day ago
stochasticai
xTuring stochasticai
207
2.6k
apache-2.0
33
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
593 commits to main branch, last one 2 months ago
dvmazur
mixtral-offloading dvmazur
227
2.3k
mit
29
Run Mixtral-8x7B models in Colab or consumer desktops
llm pytorch offloading google-colab quantization deep-learning colab-notebook language-model mixture-of-experts
Created 2023-12-15
86 commits to master branch, last one 11 months ago
intel
neural-compressor intel
258
2.3k
apache-2.0
33
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training
Created 2020-07-21
3,699 commits to master branch, last one 2 days ago
666DZY666
micronet 666DZY666
478
2.2k
mit
41
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
bnn twn onnx dorefa pruning pytorch tensorrt xnor-net quantization network-slimming group-convolution model-compression network-in-network tensorrt-int8-python convolutional-networks neuromorphic-computing integer-arithmetic-only batch-normalization-fuse post-training-quantization quantization-aware-training
Created 2019-12-04
295 commits to master branch, last one 3 years ago
quic
aimet quic
391
2.2k
other
51
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
auto-ml pruning opensource compression open-source quantization deep-learning machine-learning network-compression deep-neural-networks network-quantization
Created 2020-04-21
2,434 commits to develop branch, last one 17 hours ago
Efficient-ML
Awesome-Model-Quantization Efficient-ML
208
1.9k
unknown
65
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (pape...
awesome binarization quantization deep-learning binary-network model-compression model-acceleration model-quantization efficient-deep-learning binarized-neural-networks lightweight-neural-network
Created 2018-10-18
299 commits to master branch, last one about a month ago
pytorch
ao pytorch
188
1.7k
bsd-3-clause
43
PyTorch native quantization and sparsity for training and inference
mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization
Created 2023-11-03
866 commits to main branch, last one 18 hours ago
intel
intel-extension-for-pytorch intel
255
1.7k
apache-2.0
41
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
intel pytorch quantization deep-learning neural-network machine-learning
Created 2020-04-15
2,396 commits to main branch, last one 3 days ago
OpenPPL
ppq OpenPPL
239
1.6k
apache-2.0
17
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
cuda onnx caffe pytorch open-source quantization deep-learning neural-network
Created 2021-12-30
291 commits to master branch, last one 9 months ago
PaddlePaddle
PaddleSlim PaddlePaddle
347
1.6k
apache-2.0
91
PaddleSlim is an open-source library for deep model compression and architecture search.
nas bert ernie yolov5 yolov6 yolov7 pruning sparsity tensorrt detection compression transformer distillation quantization segmentation
Created 2019-12-16
1,246 commits to develop branch, last one 17 days ago
open-mmlab
mmrazor open-mmlab
231
1.5k
apache-2.0
22
OpenMMLab Model Compression Toolbox and Benchmark.
nas spos darts pruning pytorch autoslim detection quantization segmentation classification knowledge-distillation
Created 2021-12-22
229 commits to main branch, last one about a year ago
tensorflow
model-optimization tensorflow
324
1.5k
apache-2.0
120
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
ml keras pruning sparsity tensorflow compression optimization quantization deep-learning machine-learning model-compression quantized-networks quantized-training quantized-neural-networks
Created 2018-10-31
834 commits to master branch, last one 5 days ago
RWKV
rwkv.cpp RWKV
100
1.4k
mit
23
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
llm ggml rwkv quantization deep-learning language-model machine-learning
Created 2023-03-30
421 commits to master branch, last one 4 months ago
Xilinx
brevitas Xilinx
199
1.2k
other
34
Brevitas: neural network quantization in PyTorch
ptq qat fpga xilinx pytorch brevitas quantization deep-learning neural-networks hardware-acceleration
Created 2018-07-10
1,406 commits to master branch, last one 2 months ago
huawei-noah
Efficient-Computing huawei-noah
212
1.2k
unknown
24
Efficient computing methods developed by Huawei Noah's Ark Lab
pruning quantization self-supervised model-compression binary-neural-networks knowledge-distillation
Created 2019-09-04
157 commits to master branch, last one about a month ago
RahulSChand
gpu_poor RahulSChand
60
1.2k
unknown
7
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
gpu llm ggml llama llama2 pytorch llamacpp huggingface quantization language-model
Created 2023-09-12
72 commits to main branch, last one 17 days ago
openvinotoolkit
training_extensions openvinotoolkit
444
1.1k
apache-2.0
47
Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
automl pytorch datumaro openvino quantization deep-learning computer-vision machine-learning object-detection anomaly-detection transfer-learning action-recognition image-segmentation image-classification incremental-learning self-supervised-learning semi-supervised-learning neural-networks-compression hyper-parameter-optimization
Created 2018-10-26
1,031 commits to develop branch, last one a day ago