Search Results - RepositoryStats

2 results found Sort:

mit

Exporting YOLOv5 for CPU inference with ONNX and OpenVINO

yolov5 onnx-inference object-detection cpu-inference-api openvino-inference-engine

Created 2021-06-29

24 commits to master branch, last one 7 months ago

unknown

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

cpu llm npu aipc gemma llama phi-3 ipexllm mistral windows directml openvino directx-12 llm-serving llm-inference model-inference open-source-llm openvino-inference-engine

Created 2024-06-17

41 commits to main branch, last one 5 months ago