1 result found Sort:

NotPunchnox
rkllama NotPunchnox
14
96
gpl-3.0
4
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
ai ia llm npu client python rk3576 rk3588 server npu-llm offline llm-apps orangepi rockchip orange-pi orangepi5 orangepi5pro client-server llm-inference
Created 2024-12-30
178 commits to main branch, last one 2 days ago