1 result found Sort:

Infini-AI-Lab
MagicPIG Infini-AI-Lab
14
197
apache-2.0
2
[ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
gpu-cpu decoding llm-inference lsh-algorithm
Created 2024-10-21
50 commits to v0.2 branch, last one 3 months ago