11 results found Sort:

Efficient-ML
Awesome-Model-Quantization Efficient-ML
209
1.9k
unknown
65
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (pape...
awesome binarization quantization deep-learning binary-network model-compression model-acceleration model-quantization efficient-deep-learning binarized-neural-networks lightweight-neural-network
Created 2018-10-18
299 commits to master branch, last one about a month ago
horseee
Awesome-Efficient-LLM horseee
99
1.4k
unknown
41
A curated list for Efficient Large Language Models
llm compression efficient-llm language-model llm-compression model-quantization pruning-algorithms knowledge-distillation
Created 2023-05-22
541 commits to main branch, last one 17 hours ago
inferflow
inferflow inferflow
24
236
mit
8
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
moe qwen bloom gemma phi-2 falcon llama2 m2m100 minicpm mistral mixtral deepseek internlm llamacpp baichuan2 llm-inference mixture-of-experts model-quantization multi-gpu-inference
Created 2023-12-26
116 commits to main branch, last one 9 months ago
datawhalechina
awesome-compression datawhalechina
29
215
unknown
3
模型压缩的小白入门教程
kd prune tinyml compression quantization model-pruning model-compression model-quantization knowledge-distillation neural-architecture-search
Created 2023-12-28
136 commits to main branch, last one about a month ago
sayakpaul
Adventures-in-TensorFlow-Lite sayakpaul
34
172
apache-2.0
12
This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.
tf-hub pruning inference on-device-ml tensorflow-2 tf-lite-model tensorflow-lite model-optimization model-quantization post-training-quantization quantization-aware-training
Created 2020-04-29
143 commits to master branch, last one about a year ago
Efficient-ML
Awesome-Efficient-LLM-Diffusion Efficient-ML
11
164
unknown
5
A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including language and vision, we are continuously improving the project. Welcom...
llm aigc awesome pruning distillation diffusion-models generative-model model-compression model-quantization large-language-models efficient-deep-learning
Created 2023-05-22
49 commits to main branch, last one about a month ago
RodolfoFerro
psychopathology-fer-assistant RodolfoFerro
25
74
gpl-3.0
7
[WINNER! 🏆] Psychopathology FER Assistant. Because mental health matters. My project submission for #TFWorld TF 2.0 Challenge at Devpost.
dash flask python tflite kaggle-api tensorflow google-colab raspberry-pi assistant-app kaggle-dataset model-quantization dash-bootstrap-components firebase-realtime-database
Created 2019-11-27
43 commits to master branch, last one 2 years ago
htqin
BiBench htqin
4
54
unknown
2
[ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binarization.
benchmark icml-2023 binarization model-compression model-quantization binary-neural-networks binarized-neural-networks
Created 2023-05-01
10 commits to main branch, last one 10 months ago
htqin
QuantSR htqin
2
43
apache-2.0
3
[NeurIPS 2023 Spotlight] This project is the official implementation of our accepted NeurIPS 2023 (spotlight) paper QuantSR: Accurate Low-bit Quantization for Efficient Image Super-Resolution.
super-resolution model-quantization quantized-neural-networks
Created 2023-10-19
3 commits to main branch, last one 7 months ago
seonglae
llama2gptq seonglae
0
30
mit
2
Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization.
gpt rye cuda chatai llama2 chatbot chatgpt llama-2 langchain quantization transformers streamlit-chat model-quantization question-answering
Created 2023-06-02
78 commits to main branch, last one about a year ago
nbasyl
OFQ nbasyl
0
28
mit
2
The official implementation of the ICML 2023 paper OFQ-ViT
icml icml2023 model-compression quantization-awar model-quantization vision-transformer vision-transformers model-compression-papers
Created 2023-05-09
22 commits to main branch, last one about a year ago