31 results found Sort:

699
10.8k
mit
80
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Created 2023-07-22
353 commits to master branch, last one about a year ago
349
2.7k
mit
57
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Created 2023-05-09
1,739 commits to master branch, last one a day ago
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Created 2023-10-17
1,885 commits to main branch, last one 18 days ago
63
1.3k
other
30
llama.go is like llama.cpp in pure Golang!
Created 2023-03-19
270 commits to main branch, last one 2 months ago
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Created 2023-08-12
179 commits to master branch, last one 23 days ago
Create characters in Unity with LLMs!
Created 2023-12-27
1,141 commits to main branch, last one 18 days ago
Self-evaluating interview for AI coders
Created 2023-05-27
737 commits to main branch, last one a day ago
30
455
mit
10
Run AI ✨ assistant locally! with simple API for Node.js 🚀
Created 2023-03-25
189 commits to main branch, last one 5 months ago
LLama.cpp rust bindings
Created 2023-06-15
115 commits to master branch, last one 4 months ago
React Native binding of llama.cpp
Created 2023-08-02
237 commits to main branch, last one 2 days ago
40
241
apache-2.0
7
This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.
Created 2023-05-20
45 commits to main branch, last one 4 months ago
Local ML voice chat using high-end models.
Created 2023-12-17
276 commits to main branch, last one 5 days ago
Run LLMs locally. A clojure wrapper for llama.cpp.
Created 2023-07-19
217 commits to main branch, last one 4 months ago
6
140
other
7
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
Created 2023-05-04
491 commits to main branch, last one 3 months ago
20
127
apache-2.0
7
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
Created 2021-05-27
2,986 commits to master branch, last one 5 months ago
11
127
agpl-3.0
11
Making offline AI models accessible to all types of edge devices.
Created 2023-04-09
55 commits to main branch, last one about a year ago
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
Created 2023-04-03
16 commits to main branch, last one about a year ago
9
97
unknown
5
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
Created 2023-07-21
92 commits to master branch, last one 11 months ago
Langport is a language model inference service
Created 2023-05-10
237 commits to main branch, last one 4 months ago
27
88
apache-2.0
4
InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.
Created 2023-05-03
159 commits to main branch, last one 5 months ago
16
75
apache-2.0
2
📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy
Created 2023-08-13
17 commits to main branch, last one 6 months ago
16
70
apache-2.0
13
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource...
Created 2024-02-28
116 commits to main branch, last one 6 months ago
3
54
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
Created 2023-11-09
31 commits to main branch, last one 9 months ago
Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.
Created 2023-02-24
776 commits to main branch, last one 22 days ago
1
33
agpl-3.0
2
Local LLMs in your DAW!
Created 2024-09-14
29 commits to main branch, last one about a month ago
End-to-end scripting workflow to automatically generate show notes from audio/video transcripts with Whisper.cpp, Llama.cpp, yt-dlp, and Commander.js
Created 2024-04-17
270 commits to main branch, last one 5 days ago
Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
Created 2023-09-23
63 commits to main branch, last one about a month ago
Python bindings to llama.cpp
Created 2023-03-22
153 commits to main branch, last one about a year ago
llama.cpp gguf file parser for javascript
Created 2023-12-27
34 commits to master branch, last one 5 months ago
Wrapper around llama-cpp-python for chat completion with LLaMA v2 models.
Created 2023-07-20
8 commits to main branch, last one about a year ago