33 results found Sort:

711
10.9k
mit
81
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Created 2023-07-22
353 commits to master branch, last one about a year ago
381
2.9k
mit
56
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Created 2023-05-09
1,857 commits to master branch, last one 4 days ago
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Created 2023-10-17
1,885 commits to main branch, last one 3 months ago
65
1.3k
other
30
llama.go is like llama.cpp in pure Golang!
Created 2023-03-19
270 commits to main branch, last one 4 months ago
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Created 2023-08-12
193 commits to master branch, last one 11 days ago
Create characters in Unity with LLMs!
Created 2023-12-27
1,199 commits to main branch, last one about a month ago
Self-evaluating interview for AI coders
Created 2023-05-27
763 commits to main branch, last one 18 days ago
31
465
mit
9
Run AI ✨ assistant locally! with simple API for Node.js 🚀
Created 2023-03-25
189 commits to main branch, last one 7 months ago
React Native binding of llama.cpp
Created 2023-08-02
294 commits to main branch, last one 2 days ago
LLama.cpp rust bindings
Created 2023-06-15
115 commits to master branch, last one 7 months ago
44
260
apache-2.0
7
This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.
Created 2023-05-20
45 commits to main branch, last one 7 months ago
Local ML voice chat using high-end models.
Created 2023-12-17
286 commits to main branch, last one 2 days ago
Run LLMs locally. A clojure wrapper for llama.cpp.
Created 2023-07-19
240 commits to main branch, last one 3 days ago
7
150
other
7
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
Created 2023-05-04
491 commits to main branch, last one 5 months ago
14
135
agpl-3.0
11
Making offline AI models accessible to all types of edge devices.
Created 2023-04-09
55 commits to main branch, last one about a year ago
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
Created 2023-04-03
16 commits to main branch, last one about a year ago
10
104
unknown
4
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
Created 2023-07-21
92 commits to master branch, last one about a year ago
Langport is a language model inference service
Created 2023-05-10
237 commits to main branch, last one 7 months ago
29
92
apache-2.0
4
InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.
Created 2023-05-03
159 commits to main branch, last one 8 months ago
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Created 2024-05-28
172 commits to main branch, last one 15 hours ago
18
78
apache-2.0
2
📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy
Created 2023-08-13
17 commits to main branch, last one 9 months ago
16
77
apache-2.0
11
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource...
Created 2024-02-28
116 commits to main branch, last one 8 months ago
A C++ implementation of Open Interpreter, based on llama.cpp. / Open Interpreter 的 C++ 实现,基于 llama.cpp
Created 2024-11-25
47 commits to main branch, last one 23 days ago
4
58
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
Created 2023-11-09
31 commits to main branch, last one 11 months ago
End-to-end scripting workflow to automatically generate show notes from audio/video transcripts with Whisper.cpp, Ollama, yt-dlp, and Commander.js
Created 2024-04-17
490 commits to main branch, last one a day ago
3
44
agpl-3.0
3
Local LLMs in your DAW!
Created 2024-09-14
29 commits to main branch, last one 4 months ago
Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
Created 2023-09-23
63 commits to main branch, last one 4 months ago
Run llama.cpp in a GPU accelerated Docker container
Created 2023-12-21
74 commits to main branch, last one 15 days ago
llama.cpp gguf file parser for javascript
Created 2023-12-27
35 commits to master branch, last one 2 months ago
4
30
bsd-3-clause
7
Local Generative AI
Created 2024-11-02
29 commits to main branch, last one 26 days ago