Search Results - RepositoryStats

701

11.0k

apache-2.0

57

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llm llama mlops llama2 llmops vicuna bentoml llm-ops mistral openllm llama3-1 llama3-2 fine-tuning llm-serving llm-inference llama3-2-vision model-inference open-source-llm

Created 2023-04-19

1,881 commits to main branch, last one a day ago

Awesome-EdgeAI wangxb96

7

77

mit

2

Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"

edge-ai tiny-ml awesome-list model-design deep-learning edge-computing model-inference machine-learning model-deployment model-compression data-preprocessing model-acceleration efficient-algorithm

Created 2023-01-19

125 commits to main branch, last one 2 months ago

CLIP-API-service bentoml

4

59

apache-2.0

4

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

clip mlops openai-clip cloud-native model-serving ai-applications model-inference model-inference-service

Created 2023-04-18

26 commits to main branch, last one about a year ago

deepx array2d

2

38

apache-2.0

1

Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & Heterogeneous Hardware Support

model-serving model-inference cuda-acceleration simd-optimization distributed-training deep-learning-framework heterogeneous-computing high-performance-computing

Created 2025-02-03

239 commits to main branch, last one 10 hours ago

embeddedllm EmbeddedLLM

1

34

unknown

2

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

cpu llm npu aipc gemma llama phi-3 ipexllm mistral windows directml openvino directx-12 llm-serving llm-inference model-inference open-source-llm openvino-inference-engine

Created 2024-06-17

41 commits to main branch, last one 5 months ago

edge-tpu-silva DAVIDNYARKO123

3

29

unknown

2

Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.

fps pycoral coral-tpu raspberry-pi edge-computing raspberry-pi-4 model-inference machine-learning object-detection

Created 2024-02-16

42 commits to main branch, last one 11 months ago