Search Results - RepositoryStats

43

664

mit

18

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

llm llama localllm transformer quantization small-models text-generation model-compression efficient-inference large-language-models post-training-quantization natural-language-processing

Created 2023-06-12

50 commits to main branch, last one 9 months ago

27

319

unknown

12

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

llm llama mistral localllm localllama compression transformer quantization small-models efficient-model text-generation model-compression efficient-inference large-language-models natural-language-processing

Created 2024-01-31

12 commits to main branch, last one 5 months ago

43

267

other

21

OpenSSA: Small Specialist Agents based on Domain-Aware Neurosymbolic Agent (DANA) architecture for industrial problem-solving

small-models industrial-ai domain-knowledge specialist-agents

Created 2023-06-26

3,097 commits to main branch, last one 15 days ago