1 result found Sort:

SJTU-IPADS
PowerInfer SJTU-IPADS
419
8.0k
mit
78
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
llm llama falcon bamboo-7b llm-inference local-inference large-language-models
Created 2023-12-15
1,584 commits to main branch, last one 3 months ago