1 result found Sort:

bytedance
ShadowKV bytedance
6
140
apache-2.0
3
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
low-rank research cpu-offload long-context llm-inference high-throughput sparse-attention
Created 2024-10-22
13 commits to main branch, last one about a month ago