Search Results - RepositoryStats

971

4.5k

apache-2.0

210

Tengine is a lite, high performance, modular inference engine for embedded device

acl arm cnn npu cuda mips onnx nvdla riscv x86-64 pytorch tensorrt container supperedge tensorflow machine-learning artificial-intelligence

Created 2017-12-30

695 commits to tengine-lite branch, last one 6 months ago

ai-dev-gallery microsoft

111

916

mit

18

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Created 2024-11-06

984 commits to main branch, last one 20 hours ago

useful-transformers usefulsensors

42

426

gpl-3.0

26

Efficient Inference of Transformer models

cpp npu rockchip openai-whisper neural-networks transformer-models

Created 2023-08-26

18 commits to main branch, last one 11 months ago

Free-TPU embedeep

61

253

mit

8

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

npu rnn tpu fpga free lstm zynq caffe darknet pytorch hardware npu-compiler deep-learning cnn-accelerator

Created 2018-12-25

44 commits to master branch, last one about a year ago

ax-samples AXERA-TECH

54

248

bsd-3-clause

17

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

arm npu onnx axera yolox yolo11 yolov5 yolov6 yolov8 yolov10 yolo-world-v2 neural-network artificial-intelligence

Created 2022-05-13

210 commits to main branch, last one 19 days ago

TinyVision YuzukiHD

27

174

lgpl-2.1

7

TinyVision - A Tiny Linux Board / IPC / Server / Router / And so on...

cv npu sbc oshw v851s opencv

Created 2023-11-13

192 commits to main branch, last one 2 days ago

FREE-TPU-V3plus-for-FPGA embedeep

17

139

mit

6

FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference

ai npu tpu fpga lstm zynq caffe pytorch accelerator ai-compiler transformer ai-processor npu-compiler tpu-acceleration transformer-accelerator

Created 2023-05-06

14 commits to main branch, last one about a year ago

ezrknpu Pelochus

7

134

gpl-3.0

9

Easy usage of Rockchip's NPUs found in RK3588 and similar chips

llm npu rk3588 rockchip neural-networks

Created 2024-04-11

8 commits to main branch, last one 13 days ago

turnkeyml onnx

18

112

apache-2.0

13

LLM SDK for OnnxRuntime GenAI (OGA)

ai gpu llm npu x86 onnx nvidia pytorch benchmark toolchain onnxruntime-genai

Created 2023-11-30

131 commits to main branch, last one a day ago

universal_NPU-CNN_accelerator thousrm

13

111

mit

2

hardware design of universal NPU(CNN accelerator) for various convolution neural network

cnn npu verilog asic-design cnn-accelerator hardware-design

Created 2023-07-18

186 commits to main branch, last one 17 days ago

ONNXim PSAL-POSTECH

23

99

mit

1

ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference

npu onnx pytorch simulator

Created 2023-05-09

268 commits to master branch, last one 3 months ago

YoloV5-NPU Qengineering

13

96

bsd-3-clause

3

YoloV5 NPU for the RK3566/68/88

npu rknpu rk3566 rk3568 rk3588 rock-5 rock5c yolov5 rk3588s yolov5s orange-pi-5 deep-learning radxa-zero-3w radxa-zero-3-npu

Created 2023-08-29

34 commits to main branch, last one 9 months ago

rkllama NotPunchnox

14

96

gpl-3.0

4

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

ai ia llm npu client python rk3576 rk3588 server npu-llm offline llm-apps orangepi rockchip orange-pi orangepi5 orangepi5pro client-server llm-inference

Created 2024-12-30

178 commits to main branch, last one a day ago

PowerServe powerserve-project

8

92

apache-2.0

6

High-speed and easy-use LLM serving framework for local deployment

llm npu qwen llama smartphone llm-serving smallthinker llm-inference

Created 2025-01-14

43 commits to main branch, last one 4 days ago

MaixCDK sipeed

19

72

other

11

C/C++ development kit for Sipeed Maix ecosystem boards

ai npu maixpy vision embeded

Created 2023-12-20

624 commits to main branch, last one 2 days ago

edgerunner neuralize-ai

4

65

mit

2

Simplified AI runtime integration for mobile app development

gpu ios npu qnn coreml mobile tflite android cplusplus inference on-device-ai cross-platform neural-network

Created 2024-06-21

355 commits to main branch, last one 7 months ago

YoloV8-NPU Qengineering

10

49

bsd-3-clause

1

YoloV8 NPU for the RK3566/68/88

npu rk3566 rk3568 rk3588 rknpu2 rock-5 rock5c yolov8 yolov8n orange-pi-5 deep-learning radxa-zero-3w radxa-zero-3-npu

Created 2024-04-28

15 commits to main branch, last one 9 months ago

yolov7-rknn thnak

8

48

gpl-3.0

0

Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).

npu rknn rk3562 rk3566 rk3568 rk3588 rv1103 rv1106 yolov7 rk3588s rockchip object-detection

Created 2023-06-02

25 commits to main branch, last one 11 months ago

rkllm_chat wudingjian

6

37

unknown

5

将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理

llm npu rknpu rk3588 rockchip

Created 2024-09-25

36 commits to main branch, last one 5 months ago

embeddedllm EmbeddedLLM

1

34

unknown

2

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

cpu llm npu aipc gemma llama phi-3 ipexllm mistral windows directml openvino directx-12 llm-serving llm-inference model-inference open-source-llm openvino-inference-engine

Created 2024-06-17

41 commits to main branch, last one 5 months ago

edgerunner-android neuralize-ai

0

30

mit

1

Kotlin bindings for Edgerunner

npu qnn mobile tflite android inference on-device-ai neural-network

Created 2024-07-02

71 commits to main branch, last one 8 months ago

Radxa-Zero-3-NPU-Ubuntu22 Qengineering

1

29

bsd-3-clause

1

Radxa Zero 3W/E image with Ubuntu 22, OpenCV, deep learning frameworks and NPU drivers

npu ncnn opencv rk3566 rknpu2 ubuntu22 radxa-zero3 radxa-zero3w radxa-zero-3e radxa-zero-3w radxa-zero3-npu rknpu-model-zoo

Created 2024-04-23

11 commits to main branch, last one 26 days ago