148 results found Sort:

hiyouga
LLaMA-Factory hiyouga
4.3k
34.6k
apache-2.0
214
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,377 commits to main branch, last one a day ago
ymcui
Chinese-LLaMA-Alpaca ymcui
1.9k
18.4k
apache-2.0
185
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm nlp plm lora llama alpaca llama-2 alpaca-2 quantization large-language-models pre-trained-language-models
Created 2023-03-15
556 commits to main branch, last one 6 months ago
SYSTRAN
faster-whisper SYSTRAN
1.0k
12.6k
mit
125
Faster Whisper transcription with CTranslate2
openai whisper inference transformer quantization deep-learning speech-to-text speech-recognition
Created 2023-02-11
234 commits to master branch, last one 23 hours ago
UFund-Me
Qbot UFund-Me
1.1k
7.9k
mit
105
[🔥updating ...] AI 自动量化交易机器人(完全本地部署) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant
qlib funds bitcoin fintech pytrade trade-bot blockchain strategies trademarks quant-trade quant-trader quantization deep-learning machine-learning quantitative-finance quantitative-trading
Created 2022-11-23
143 commits to main branch, last one 11 days ago
kornelski
pngquant kornelski
486
5.2k
other
131
Lossy PNG compressor — pngquant command based on libimagequant library
c png stdin palette quality smaller pngquant conversion quantization png-compression image-optimization
Created 2009-09-17
1,206 commits to main branch, last one 4 months ago
AutoGPTQ
AutoGPTQ AutoGPTQ
484
4.5k
mit
31
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
nlp llms pytorch inference transformer quantization transformers deep-learning large-language-models
Created 2023-04-13
761 commits to main branch, last one about a month ago
IntelLabs
distiller IntelLabs
801
4.4k
apache-2.0
132
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
onnx pruning pytorch early-exit group-lasso distillation quantization truncated-svd regularization jupyter-notebook pruning-structures network-compression deep-neural-networks automl-for-compression
This repository has been archived (exclude archived)
Created 2018-04-24
643 commits to master branch, last one about a year ago
OpenNMT
CTranslate2 OpenNMT
303
3.4k
mit
60
Fast inference engine for Transformer models
avx cpp mkl avx2 cuda gemm neon onednn openmp thrust opennmt inference intrinsics quantization deep-learning parallel-computing transformer-models machine-translation deep-neural-networks neural-machine-translation
Created 2019-09-23
2,186 commits to master branch, last one 2 days ago
neuralmagic
deepsparse neuralmagic
173
3.0k
other
57
Sparsity-aware deep learning inference runtime for CPUs
nlp cpus onnx pruning inference deepsparse performance quantization llm-inference sparsification computer-vision machinelearning object-detection pretrained-models
Created 2020-12-14
1,052 commits to main branch, last one 4 months ago
huawei-noah
Pretrained-Language-Model huawei-noah
626
3.0k
unknown
56
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
quantization model-compression pretrained-models knowledge-distillation large-scale-distributed
Created 2019-12-02
162 commits to master branch, last one 10 months ago
IntelLabs
nlp-architect IntelLabs
448
2.9k
apache-2.0
164
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
nlp nlu bert dynet pytorch tensorflow deeplearning quantization transformers deep-learning
This repository has been archived (exclude archived)
Created 2018-05-17
957 commits to master branch, last one 2 years ago
aaron-xichen
pytorch-playground aaron-xichen
612
2.6k
mit
53
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
pytorch quantization pytorch-tutorial pytorch-tutorials
Created 2017-04-28
17 commits to master branch, last one 4 years ago
stochasticai
xTuring stochasticai
207
2.6k
apache-2.0
33
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
593 commits to main branch, last one about a month ago
huggingface
optimum huggingface
469
2.6k
apache-2.0
58
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
onnx intel habana tflite pytorch training graphcore inference onnxruntime optimization quantization transformers
Created 2021-07-20
1,129 commits to main branch, last one a day ago
dvmazur
mixtral-offloading dvmazur
226
2.3k
mit
29
Run Mixtral-8x7B models in Colab or consumer desktops
llm pytorch offloading google-colab quantization deep-learning colab-notebook language-model mixture-of-experts
Created 2023-12-15
86 commits to master branch, last one 10 months ago
intel
neural-compressor intel
257
2.2k
apache-2.0
33
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training
Created 2020-07-21
3,619 commits to master branch, last one a day ago
666DZY666
micronet 666DZY666
478
2.2k
mit
41
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
bnn twn onnx dorefa pruning pytorch tensorrt xnor-net quantization network-slimming group-convolution model-compression network-in-network tensorrt-int8-python convolutional-networks neuromorphic-computing integer-arithmetic-only batch-normalization-fuse post-training-quantization quantization-aware-training
Created 2019-12-04
295 commits to master branch, last one 3 years ago
quic
aimet quic
383
2.2k
other
49
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
auto-ml pruning opensource compression open-source quantization deep-learning machine-learning network-compression deep-neural-networks network-quantization
Created 2020-04-21
2,289 commits to develop branch, last one a day ago
Efficient-ML
Awesome-Model-Quantization Efficient-ML
206
1.9k
unknown
62
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (pape...
awesome binarization quantization deep-learning binary-network model-compression model-acceleration model-quantization efficient-deep-learning binarized-neural-networks lightweight-neural-network
Created 2018-10-18
299 commits to master branch, last one 19 days ago
intel
intel-extension-for-pytorch intel
248
1.6k
apache-2.0
38
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
intel pytorch quantization deep-learning neural-network machine-learning
Created 2020-04-15
2,367 commits to main branch, last one 9 hours ago
pytorch
ao pytorch
177
1.6k
bsd-3-clause
41
PyTorch native quantization and sparsity for training and inference
mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization
Created 2023-11-03
776 commits to main branch, last one 13 hours ago
PaddlePaddle
PaddleSlim PaddlePaddle
345
1.6k
apache-2.0
91
PaddleSlim is an open-source library for deep model compression and architecture search.
nas bert ernie yolov5 yolov6 yolov7 pruning sparsity tensorrt detection compression transformer distillation quantization segmentation
Created 2019-12-16
1,245 commits to develop branch, last one a day ago
OpenPPL
ppq OpenPPL
236
1.6k
apache-2.0
17
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
cuda onnx caffe pytorch open-source quantization deep-learning neural-network
Created 2021-12-30
291 commits to master branch, last one 8 months ago
tensorflow
model-optimization tensorflow
323
1.5k
apache-2.0
120
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
ml keras pruning sparsity tensorflow compression optimization quantization deep-learning machine-learning model-compression quantized-networks quantized-training quantized-neural-networks
Created 2018-10-31
833 commits to master branch, last one 17 days ago
open-mmlab
mmrazor open-mmlab
229
1.5k
apache-2.0
20
OpenMMLab Model Compression Toolbox and Benchmark.
nas spos darts pruning pytorch autoslim detection quantization segmentation classification knowledge-distillation
Created 2021-12-22
229 commits to main branch, last one about a year ago
RWKV
rwkv.cpp RWKV
99
1.4k
mit
22
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
llm ggml rwkv quantization deep-learning language-model machine-learning
Created 2023-03-30
421 commits to master branch, last one 3 months ago
huawei-noah
Efficient-Computing huawei-noah
210
1.2k
unknown
24
Efficient computing methods developed by Huawei Noah's Ark Lab
pruning quantization self-supervised model-compression binary-neural-networks knowledge-distillation
Created 2019-09-04
157 commits to master branch, last one 15 days ago
Xilinx
brevitas Xilinx
197
1.2k
other
34
Brevitas: neural network quantization in PyTorch
ptq qat fpga xilinx pytorch brevitas quantization deep-learning neural-networks hardware-acceleration
Created 2018-07-10
1,406 commits to master branch, last one about a month ago
RahulSChand
gpu_poor RahulSChand
58
1.2k
unknown
6
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
gpu llm ggml llama llama2 pytorch llamacpp huggingface quantization language-model
Created 2023-09-12
71 commits to main branch, last one 19 days ago
openvinotoolkit
training_extensions openvinotoolkit
443
1.1k
apache-2.0
46
Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
automl pytorch datumaro openvino quantization deep-learning computer-vision machine-learning object-detection anomaly-detection transfer-learning action-recognition image-segmentation image-classification incremental-learning self-supervised-learning semi-supervised-learning neural-networks-compression hyper-parameter-optimization
Created 2018-10-26
1,007 commits to develop branch, last one a day ago