34 results found Sort:

707
10.9k
mit
82
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Created 2023-07-22
353 commits to master branch, last one about a year ago
359
2.8k
mit
56
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Created 2023-05-09
1,769 commits to master branch, last one 4 days ago
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Created 2023-10-17
1,885 commits to main branch, last one about a month ago
64
1.3k
other
30
llama.go is like llama.cpp in pure Golang!
Created 2023-03-19
270 commits to main branch, last one 3 months ago
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Created 2023-08-12
184 commits to master branch, last one 16 days ago
Create characters in Unity with LLMs!
Created 2023-12-27
1,199 commits to main branch, last one 6 days ago
Self-evaluating interview for AI coders
Created 2023-05-27
746 commits to main branch, last one 7 days ago
30
459
mit
10
Run AI ✨ assistant locally! with simple API for Node.js 🚀
Created 2023-03-25
189 commits to main branch, last one 6 months ago
React Native binding of llama.cpp
Created 2023-08-02
251 commits to main branch, last one 2 days ago
LLama.cpp rust bindings
Created 2023-06-15
115 commits to master branch, last one 6 months ago
42
250
apache-2.0
7
This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.
Created 2023-05-20
45 commits to main branch, last one 5 months ago
Local ML voice chat using high-end models.
Created 2023-12-17
281 commits to main branch, last one 17 days ago
Run LLMs locally. A clojure wrapper for llama.cpp.
Created 2023-07-19
217 commits to main branch, last one 5 months ago
6
145
other
7
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
Created 2023-05-04
491 commits to main branch, last one 4 months ago
20
133
apache-2.0
7
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
Created 2021-05-27
2,986 commits to master branch, last one 6 months ago
13
129
agpl-3.0
12
Making offline AI models accessible to all types of edge devices.
Created 2023-04-09
55 commits to main branch, last one about a year ago
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
Created 2023-04-03
16 commits to main branch, last one about a year ago
10
100
unknown
5
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
Created 2023-07-21
92 commits to master branch, last one about a year ago
Langport is a language model inference service
Created 2023-05-10
237 commits to main branch, last one 5 months ago
27
89
apache-2.0
4
InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.
Created 2023-05-03
159 commits to main branch, last one 6 months ago
A C++ implementation of Open Interpreter, based on llama.cpp. / Open Interpreter 的 C++ 实现,基于 llama.cpp
Created 2024-11-25
31 commits to main branch, last one 12 days ago
17
78
apache-2.0
2
📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy
Created 2023-08-13
17 commits to main branch, last one 7 months ago
16
72
apache-2.0
12
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource...
Created 2024-02-28
116 commits to main branch, last one 7 months ago
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Created 2024-05-28
151 commits to main branch, last one 13 days ago
3
56
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
Created 2023-11-09
31 commits to main branch, last one 10 months ago
Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.
Created 2023-02-24
828 commits to main branch, last one 5 days ago
End-to-end scripting workflow to automatically generate show notes from audio/video transcripts with Whisper.cpp, Ollama, yt-dlp, and Commander.js
Created 2024-04-17
333 commits to main branch, last one 5 days ago
2
37
agpl-3.0
2
Local LLMs in your DAW!
Created 2024-09-14
29 commits to main branch, last one 3 months ago
Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
Created 2023-09-23
63 commits to main branch, last one 2 months ago
llama.cpp gguf file parser for javascript
Created 2023-12-27
35 commits to master branch, last one 13 days ago