1 result found Sort:

Infini-AI-Lab
MagicPIG Infini-AI-Lab
7
159
apache-2.0
2
MagicPIG: LSH Sampling for Efficient LLM Generation
gpu-cpu decoding llm-inference lsh-algorithm
Created 2024-10-21
50 commits to v0.2 branch, last one 5 days ago