1 result found Sort:

powerserve-project
PowerServe powerserve-project
8
92
apache-2.0
6
High-speed and easy-use LLM serving framework for local deployment
llm npu qwen llama smartphone llm-serving smallthinker llm-inference
Created 2025-01-14
43 commits to main branch, last one 6 days ago