1 result found Sort:

modelscope
dash-infer modelscope
15
137
apache-2.0
5
DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9.
cpu llm llm-inference native-engine
Created 2024-04-01
32 commits to main branch, last one 2 months ago