3 results found Sort:

SqueezeAILab
SqueezeLLM SqueezeAILab
38
593
mit
17
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
llm llama localllm transformer quantization small-models text-generation model-compression efficient-inference large-language-models post-training-quantization natural-language-processing
Created 2023-06-12
50 commits to main branch, last one 3 months ago
SqueezeAILab
KVQuant SqueezeAILab
18
230
unknown
14
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
llm llama mistral localllm localllama compression transformer quantization small-models efficient-model text-generation model-compression efficient-inference large-language-models natural-language-processing
Created 2024-01-31
11 commits to main branch, last one 17 days ago
aitomatic
openssa aitomatic
27
172
other
17
OpenSSA: Small Specialist Agents—Enabling Efficient, Domain-Specific Planning + Reasoning for AI
small-models industrial-ai domain-knowledge specialist-agents
Created 2023-06-26
2,442 commits to main branch, last one 21 days ago