2 results found Sort:

SJTU-IPADS
PowerInfer SJTU-IPADS
377
7.0k
mit
75
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
llm llama falcon bamboo-7b llm-inference local-inference large-language-models
Created 2023-12-15
1,579 commits to main branch, last one 12 days ago
efeslab
fiddler efeslab
16
146
apache-2.0
8
Fast Inference of MoE Models with CPU-GPU Orchestration
llm mixtral-8x7b llm-inference local-inference mixture-of-experts
Created 2024-02-05
49 commits to main branch, last one about a month ago