34 results found Sort:

getumbrel
llama-gpt getumbrel
713
11.0k
mit
82
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
ai gpt llm gpt-4 llama llama2 openai chatgpt gpt4all llama-2 localai llamacpp codellama llama-cpp code-llama self-hosted
Created 2023-07-22
353 commits to master branch, last one about a year ago
SciSharp
LLamaSharp SciSharp
414
3.1k
mit
58
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
gpt llm llama llava llama2 llama3 chatbot llamacpp llama-cpp multi-modal semantic-kernel
Created 2023-05-09
1,936 commits to master branch, last one 7 days ago
Mobile-Artificial-Intelligence
maid Mobile-Artificial-Intelligence
212
2.0k
mit
33
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
gguf llama llama2 ollama openai android chatbot chatgpt flutter mistral facebook llamacpp local-ai openorca llama-cpp mobile-ai android-ai free-chatgpt large-language-models mobile-artificial-intelligence
Created 2023-10-17
2,340 commits to main branch, last one 13 hours ago
withcatai
node-llama-cpp withcatai
120
1.4k
mit
16
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
ai gpu llm cuda gguf catai cmake llama metal nodejs vulkan grammar bindings cmake-js embedding llama-cpp json-schema self-hosted function-calling prebuilt-binaries
Created 2023-08-12
198 commits to master branch, last one 20 days ago
gotzmann
llama.go gotzmann
66
1.3k
other
31
llama.go is like llama.cpp in pure Golang!
gpt llm gpt3 gpt4 dalai llama alpaca vicuna chatgpt gpt4all llama-cpp
Created 2023-03-19
270 commits to main branch, last one 6 months ago
undreamai
LLMUnity undreamai
111
1.0k
mit
18
Create characters in Unity with LLMs!
ai llm npc rag chat llama unity chatbot gamedev unity2d unity3d dialogue character llama-cpp generative-ai game-development conversational-ai
Created 2023-12-27
1,264 commits to main branch, last one 19 days ago
the-crypt-keeper
can-ai-code the-crypt-keeper
35
579
mit
12
Self-evaluating interview for AI coders
ai llm ggml humaneval langchain llama-cpp transformers
Created 2023-05-27
766 commits to main branch, last one 2 days ago
mybigday
llama.rn mybigday
48
484
mit
9
React Native binding of llama.cpp
ios llm llama android llama-cpp react-native
Created 2023-08-02
311 commits to main branch, last one 24 days ago
withcatai
catai withcatai
33
472
mit
9
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
189 commits to main branch, last one 9 months ago
mdrokz
rust-llama.cpp mdrokz
45
379
mit
8
LLama.cpp rust bindings
cpp ffi rust llama model crates-io llama-cpp api-bindings machine-learning
Created 2023-06-15
115 commits to master branch, last one 9 months ago
jlonge4
local_llama jlonge4
46
268
apache-2.0
8
This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.
python offline langchain llama-cpp llamaindex machinelearning artificial-intelligence
Created 2023-05-20
45 commits to main branch, last one 9 months ago
Lizonghang
prima.cpp Lizonghang
18
265
mit
5
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
llama-cpp llm-inference distributed-ai on-device-llms distributed-inference
Created 2024-10-23
4,131 commits to main branch, last one a day ago
ptsochantaris
emeltal ptsochantaris
11
163
mit
5
Local ML voice chat using high-end models.
ai ml macos swift swiftui llama-cpp whisper-cpp user-interface machine-learning speech-recognition natural-language-processing
Created 2023-12-17
303 commits to main branch, last one 4 days ago
phronmophobic
llama.clj phronmophobic
9
162
mit
8
Run LLMs locally. A clojure wrapper for llama.cpp.
llm llama clojure llama-cpp
Created 2023-07-19
244 commits to main branch, last one 19 days ago
gotzmann
booster gotzmann
7
154
other
7
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
gpt llm ggml vllm llama ollama openai chatgpt exllama llamacpp llama-cpp oobabooga
Created 2023-05-04
491 commits to main branch, last one 8 months ago
gpustack
gguf-parser-go gpustack
15
146
mit
6
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
go gguf llama-box llama-cpp stable-diffusion-cpp
Created 2024-05-28
184 commits to main branch, last one 3 days ago
BrutalCoding
shady.ai BrutalCoding
15
138
agpl-3.0
12
Making offline AI models accessible to all types of edge devices.
ios web dart gguf llvm rwkv linux macos android flutter windows fastlane shady-ai llama-cpp serverpod llama-dart whisper-cpp linux-desktop cross-platform material-design
Created 2023-04-09
55 commits to main branch, last one about a year ago
nuance1979
llama-server nuance1979
14
122
mit
3
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
llama llamacpp llama-cpp chatbot-ui
Created 2023-04-03
16 commits to main branch, last one about a year ago
nrl-ai
CustomChar nrl-ai
11
109
unknown
4
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
cpp llm stt tts ggml llama llama-v2 llama-cpp whisper-cpp
Created 2023-07-21
92 commits to master branch, last one about a year ago
lucasjinreal
Crane lucasjinreal
7
96
unknown
5
A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
mllm rust qwen3 qwen2-vl llama-cpp spark-tts
Created 2025-03-19
33 commits to main branch, last one 22 days ago
R3gm
InsightSolver-Colab R3gm
30
96
apache-2.0
5
InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.
llm aiops ai-ops autogpt llama-2 llama-cpp colorization deep-learning colab-notebook text-to-speech computer-vision machine-learning object-detection stable-diffusion
Created 2023-05-03
159 commits to main branch, last one 10 months ago
vtuber-plan
langport vtuber-plan
12
94
mit
5
Langport is a language model inference service
api llm llama tabby openai chatgpt fauxpilot langchain llama-cpp chatgpt-api language-model
Created 2023-05-10
237 commits to main branch, last one 9 months ago
Abhi5h3k
PrivateDocBot Abhi5h3k
19
83
apache-2.0
2
📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy
ai gpt llm pdf gpt-4 llama llama2 openai chatgpt gpt4all llama-2 localai private llamacpp langchain llama-cpp generative privategpt self-hosted vectorstore
Created 2023-08-13
18 commits to main branch, last one 24 days ago
OpenCSGs
llm-inference OpenCSGs
16
80
apache-2.0
12
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource...
ray vllm deepspeed llama-cpp transformer llm-inference
Created 2024-02-28
116 commits to main branch, last one 11 months ago
greynewell
musegpt greynewell
2
65
agpl-3.0
3
Local LLMs in your DAW!
ai daw llm vst juce vst3 ai-music llamacpp llama-cpp vst-plugin juce-plugins music-production
Created 2024-09-14
29 commits to main branch, last one 6 months ago
ystemsrx
Code-Atlas ystemsrx
16
63
mit
4
A C++ implementation of Open Interpreter, based on llama.cpp. / Open Interpreter 的 C++ 实现，基于 llama.cpp
ai api cpp llm local llama-cpp fine-tuning interpreter lightweight cross-platform open-interpreter
Created 2024-11-25
47 commits to main branch, last one 2 months ago
rbourgeat
ImpAI rbourgeat
4
59
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion
Created 2023-11-09
31 commits to main branch, last one about a year ago
fboulnois
llama-cpp-docker fboulnois
12
35
mit
0
Run llama.cpp in a GPU accelerated Docker container
llm llama docker llama2 llama3 chatgpt mistral llama-cpp docker-compose
Created 2023-12-21
83 commits to main branch, last one 18 days ago
hyparam
hyllama hyparam
2
34
mit
3
llama.cpp gguf file parser for javascript
js ml llm gguf parser llamacpp llama-cpp hyperparam javascript machine-learning
Created 2023-12-27
35 commits to master branch, last one 4 months ago
tinyBigGAMES
Lumina tinyBigGAMES
5
33
bsd-3-clause
8
Local Generative AI
gguf win64 gen-ai pascal local-ai llama-cpp windows-10 windows-11 llm-inference
Created 2024-11-02
29 commits to main branch, last one 3 months ago