1 result found Sort:

EmbeddedLLM
embeddedllm EmbeddedLLM
0
25
unknown
3
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
cpu llm npu aipc gemma llama phi-3 ipexllm mistral windows directml openvino directx-12 llm-serving llm-inference model-inference open-source-llm openvino-inference-engine
Created 2024-06-17
41 commits to main branch, last one 2 months ago