143 results found Sort:

hiyouga
LLaMA-Factory hiyouga
3.9k
31.5k
apache-2.0
200
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,159 commits to main branch, last one a day ago
ymcui
Chinese-LLaMA-Alpaca ymcui
1.9k
18.2k
apache-2.0
183
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llm nlp plm lora llama alpaca llama-2 alpaca-2 quantization large-language-models pre-trained-language-models
Created 2023-03-15
556 commits to main branch, last one 5 months ago
SYSTRAN
faster-whisper SYSTRAN
960
11.6k
mit
121
Faster Whisper transcription with CTranslate2
openai whisper inference transformer quantization deep-learning speech-to-text speech-recognition
Created 2023-02-11
214 commits to master branch, last one 2 months ago
UFund-Me
Qbot UFund-Me
950
7.0k
mit
92
[🔥updating ...] AI 自动量化交易机器人(完全本地部署) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant
qlib funds bitcoin fintech pytrade trade-bot blockchain strategies trademarks quant-trade quant-trader quantization deep-learning machine-learning quantitative-finance quantitative-trading
Created 2022-11-23
141 commits to main branch, last one 6 days ago
kornelski
pngquant kornelski
483
5.2k
other
131
Lossy PNG compressor — pngquant command based on libimagequant library
c png stdin palette quality smaller pngquant conversion quantization png-compression image-optimization
Created 2009-09-17
1,206 commits to main branch, last one 2 months ago
AutoGPTQ
AutoGPTQ AutoGPTQ
465
4.4k
mit
31
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
nlp llms pytorch inference transformer quantization transformers deep-learning large-language-models
Created 2023-04-13
759 commits to main branch, last one about a month ago
IntelLabs
distiller IntelLabs
799
4.3k
apache-2.0
132
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
onnx pruning pytorch early-exit group-lasso distillation quantization truncated-svd regularization jupyter-notebook pruning-structures network-compression deep-neural-networks automl-for-compression
This repository has been archived (exclude archived)
Created 2018-04-24
643 commits to master branch, last one about a year ago
OpenNMT
CTranslate2 OpenNMT
287
3.2k
mit
57
Fast inference engine for Transformer models
avx cpp mkl avx2 cuda gemm neon onednn openmp thrust opennmt inference intrinsics quantization deep-learning parallel-computing transformer-models machine-translation deep-neural-networks neural-machine-translation
Created 2019-09-23
2,179 commits to master branch, last one 2 days ago
huawei-noah
Pretrained-Language-Model huawei-noah
628
3.0k
unknown
57
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
quantization model-compression pretrained-models knowledge-distillation large-scale-distributed
Created 2019-12-02
162 commits to master branch, last one 8 months ago
neuralmagic
deepsparse neuralmagic
173
3.0k
other
56
Sparsity-aware deep learning inference runtime for CPUs
nlp cpus onnx pruning inference deepsparse performance quantization llm-inference sparsification computer-vision machinelearning object-detection pretrained-models
Created 2020-12-14
1,052 commits to main branch, last one 2 months ago
IntelLabs
nlp-architect IntelLabs
446
2.9k
apache-2.0
164
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
nlp nlu bert dynet pytorch tensorflow deeplearning quantization transformers deep-learning
This repository has been archived (exclude archived)
Created 2018-05-17
957 commits to master branch, last one about a year ago
aaron-xichen
pytorch-playground aaron-xichen
610
2.6k
mit
53
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
pytorch quantization pytorch-tutorial pytorch-tutorials
Created 2017-04-28
17 commits to master branch, last one 4 years ago
stochasticai
xTuring stochasticai
206
2.6k
apache-2.0
33
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
593 commits to main branch, last one 4 days ago
huggingface
optimum huggingface
446
2.5k
apache-2.0
55
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
onnx intel habana tflite pytorch training graphcore inference onnxruntime optimization quantization transformers
Created 2021-07-20
1,098 commits to main branch, last one 10 hours ago
dvmazur
mixtral-offloading dvmazur
225
2.3k
mit
29
Run Mixtral-8x7B models in Colab or consumer desktops
llm pytorch offloading google-colab quantization deep-learning colab-notebook language-model mixture-of-experts
Created 2023-12-15
86 commits to master branch, last one 8 months ago
666DZY666
micronet 666DZY666
478
2.2k
mit
40
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
bnn twn onnx dorefa pruning pytorch tensorrt xnor-net quantization network-slimming group-convolution model-compression network-in-network tensorrt-int8-python convolutional-networks neuromorphic-computing integer-arithmetic-only batch-normalization-fuse post-training-quantization quantization-aware-training
Created 2019-12-04
295 commits to master branch, last one 2 years ago
intel
neural-compressor intel
251
2.2k
apache-2.0
34
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
awq fp4 gptq int4 int8 pruning mxformat sparsity sparsegpt auto-tuning smoothquant quantization low-precision large-language-models knowledge-distillation post-training-quantization quantization-aware-training
Created 2020-07-21
3,579 commits to master branch, last one 15 hours ago
quic
aimet quic
375
2.1k
other
50
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
auto-ml pruning opensource compression open-source quantization deep-learning machine-learning network-compression deep-neural-networks network-quantization
Created 2020-04-21
2,172 commits to develop branch, last one a day ago
htqin
awesome-model-quantization htqin
203
1.8k
unknown
61
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (pape...
awesome binarization quantization deep-learning binary-network model-compression model-acceleration model-quantization efficient-deep-learning binarized-neural-networks lightweight-neural-network
Created 2018-10-18
295 commits to master branch, last one 5 months ago
intel
intel-extension-for-pytorch intel
239
1.6k
apache-2.0
36
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
intel pytorch quantization deep-learning neural-network machine-learning
Created 2020-04-15
2,298 commits to main branch, last one 8 days ago
PaddlePaddle
PaddleSlim PaddlePaddle
345
1.6k
apache-2.0
92
PaddleSlim is an open-source library for deep model compression and architecture search.
nas bert ernie yolov5 yolov6 yolov7 pruning sparsity tensorrt detection compression transformer distillation quantization segmentation
Created 2019-12-16
1,243 commits to develop branch, last one 6 months ago
OpenPPL
ppq OpenPPL
228
1.5k
apache-2.0
17
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
cuda onnx caffe pytorch open-source quantization deep-learning neural-network
Created 2021-12-30
291 commits to master branch, last one 7 months ago
tensorflow
model-optimization tensorflow
319
1.5k
apache-2.0
119
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
ml keras pruning sparsity tensorflow compression optimization quantization deep-learning machine-learning model-compression quantized-networks quantized-training quantized-neural-networks
Created 2018-10-31
832 commits to master branch, last one 2 days ago
open-mmlab
mmrazor open-mmlab
228
1.5k
apache-2.0
20
OpenMMLab Model Compression Toolbox and Benchmark.
nas spos darts pruning pytorch autoslim detection quantization segmentation classification knowledge-distillation
Created 2021-12-22
229 commits to main branch, last one about a year ago
RWKV
rwkv.cpp RWKV
93
1.4k
mit
22
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
llm ggml rwkv quantization deep-learning language-model machine-learning
Created 2023-03-30
421 commits to master branch, last one about a month ago
huawei-noah
Efficient-Computing huawei-noah
207
1.2k
unknown
24
Efficient computing methods developed by Huawei Noah's Ark Lab
pruning quantization self-supervised model-compression binary-neural-networks knowledge-distillation
Created 2019-09-04
156 commits to master branch, last one 2 months ago
Xilinx
brevitas Xilinx
192
1.2k
other
34
Brevitas: neural network quantization in PyTorch
ptq qat fpga xilinx pytorch brevitas quantization deep-learning neural-networks hardware-acceleration
Created 2018-07-10
1,290 commits to master branch, last one 7 months ago
openvinotoolkit
training_extensions openvinotoolkit
442
1.1k
apache-2.0
45
Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
automl pytorch datumaro openvino quantization deep-learning computer-vision machine-learning object-detection anomaly-detection transfer-learning action-recognition image-segmentation image-classification incremental-learning self-supervised-learning semi-supervised-learning neural-networks-compression hyper-parameter-optimization
Created 2018-10-26
952 commits to develop branch, last one 14 hours ago
openvinotoolkit
nncf openvinotoolkit
228
916
apache-2.0
30
Neural Network Compression Framework for enhanced OpenVINO™ inference
nlp bert hawq onnx pruning pytorch openvino sparsity tensorflow compression mmdetection quantization transformers deep-learning classification object-detection semantic-segmentation mixed-precision-training quantization-aware-training
Created 2020-05-13
2,210 commits to develop branch, last one a day ago
guan-yuan
awesome-AutoML-and-Lightweight-Models guan-yuan
161
837
unknown
55
A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hype...
nas automl pytorch tensorflow awesome-list quantization meta-learning model-compression model-acceleration quantized-training architecture-search quantized-neural-network neural-architecture-search hyperparameter-optimization automated-feature-engineering
Created 2018-12-28
187 commits to master branch, last one 3 years ago