40 results found Sort:

ggerganov
llama.cpp ggerganov
10.0k
69.5k
mit
553
LLM inference in C/C++
ggml llama
Created 2023-03-10
4,374 commits to master branch, last one 10 hours ago
rustformers
llm rustformers
368
6.1k
apache-2.0
51
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
ai ml llm ggml rust
This repository has been archived (exclude archived)
Created 2023-03-13
1,093 commits to main branch, last one 6 months ago
xorbitsai
inference xorbitsai
476
5.7k
apache-2.0
42
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...
llm ggml glm4 qwen vllm gemma llama llama3 chatglm flan-t5 mistral pytorch whisper llamacpp wizardlm inference deployment openai-api machine-learning artificial-intelligence
Created 2023-06-14
1,029 commits to main branch, last one a day ago
leejet
stable-diffusion.cpp leejet
310
3.6k
mit
55
Stable Diffusion and Flux in pure C/C++
ai flux ggml img2img txt2img flux-dev cplusplus diffusion text2image image2image flux-schnell image-generation latent-diffusion stable-diffusion
Created 2023-08-13
173 commits to master branch, last one 21 days ago
guinmoon
LLMFarm guinmoon
95
1.4k
mit
20
llama and other large language models on iOS and MacOS offline using GGML library.
ai ios ggml rwkv gpt-2 llama macos swift gptneox starcoder
Created 2023-06-14
309 commits to main branch, last one 4 days ago
RWKV
rwkv.cpp RWKV
100
1.4k
mit
23
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
llm ggml rwkv quantization deep-learning language-model machine-learning
Created 2023-03-30
421 commits to master branch, last one 4 months ago
RahulSChand
gpu_poor RahulSChand
60
1.2k
unknown
7
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
gpu llm ggml llama llama2 pytorch llamacpp huggingface quantization language-model
Created 2023-09-12
72 commits to main branch, last one 17 days ago
PABannier
bark.cpp PABannier
62
750
mit
38
Suno AI's Bark model in C/C++ for fast text-to-speech generation
tts ggml inference text-to-speech machine-learning
Created 2023-07-01
109 commits to main branch, last one about a month ago
abacaj
mpt-30B-inference abacaj
94
574
mit
13
Run inference on MPT-30B using CPU
ggml mpt-30b ctransformers
Created 2023-06-26
22 commits to main branch, last one about a year ago
azkadev
whisper azkadev
36
565
other
13
Whisper Dart is a cross platform library for dart and flutter that allows converting audio to text / speech to text / inference from Open AI models
ai ios dart ggml linux macos openai speech android flutter whisper windows indonesia transcribe transformer whisper-dart speech-to-text whisper-flutter speech-synthesis speech-recognition
Created 2022-10-05
11 commits to main branch, last one 8 days ago
Maknee
minigpt4.cpp Maknee
27
561
mit
9
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
c cpp ggml minigpt4 multimodal quantization deep-learning machine-learning
Created 2023-07-15
15 commits to master branch, last one about a year ago
the-crypt-keeper
can-ai-code the-crypt-keeper
31
546
mit
12
Self-evaluating interview for AI coders
ai llm ggml humaneval langchain llama-cpp transformers
Created 2023-05-27
746 commits to main branch, last one 3 days ago
monatis
clip.cpp monatis
36
472
mit
16
CLIP inference in plain C/C++ with no extra dependencies
c cpp clip ggml multimodal image-search
Created 2023-04-28
87 commits to main branch, last one 4 months ago
shm007g
LLaMA-Cult-and-More shm007g
24
427
mit
34
Large Language Models for All, 🦙 Cult and More, Stay in touch !
gpt llm ggml gpt4 gptq llama alpaca vicuna chatgpt loralib pytorch deepspeed tensorflow transformers
Created 2023-03-30
27 commits to main branch, last one about a year ago
azkadev
bark azkadev
3
376
other
5
WIP Library Text To Speech From Suno AI's Bark in C/C++ for fast inference
ai tts bark dart fake ggml clone voice deep-learning neural-network text-to-speech machine-learning
Created 2023-07-16
23 commits to main branch, last one 8 months ago
azkadev
general_ai azkadev
1
317
other
2
GENERAL Ai Library For DART & Flutter
ai ml dart ggml piper azkadev flutter library whisper deep-learning machine-learning stable-diffusion artificial-intelligence
Created 2024-02-24
19 commits to main branch, last one 8 months ago
staghado
vit.cpp staghado
18
239
mit
7
Inference Vision Transformer (ViT) in plain C/C++ with ggml
c ai cpp cpu ggml llamacpp whisper-cpp edge-computing computer-vision vision-transformer image-classification
Created 2023-11-02
110 commits to main branch, last one 10 months ago
mayooear
private-chatbot-mpt30b-langchain mayooear
43
182
mit
4
Chat with your data privately using MPT-30b
gpt llm ggml langchain
Created 2023-06-28
3 commits to main branch, last one about a year ago
balisujohn
tortoise.cpp balisujohn
16
168
mit
15
A ggml (C++) re-implementation of tortoise-tts
to tts ggml text local speech tortoise-tts text-to-speech
Created 2023-11-25
539 commits to master branch, last one 4 months ago
mgonzs13
llama_ros mgonzs13
27
167
mit
4
llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
cpp gpt llm vlm ggml gguf ros2 llama llava rerank llamacpp llavacpp langchain reranking embeddings
Created 2023-04-01
731 commits to main branch, last one 4 days ago
abacaj
replit-3B-inference abacaj
27
154
mit
3
Run inference on replit-3B code instruct model using CPU
ggml replit replit-code ctransformers
Created 2023-06-27
22 commits to main branch, last one about a year ago
gotzmann
booster gotzmann
6
145
other
7
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
gpt llm ggml vllm llama ollama openai chatgpt exllama llamacpp llama-cpp oobabooga
Created 2023-05-04
491 commits to main branch, last one 4 months ago
chenhunghan
ialacol chenhunghan
17
144
mit
3
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
ai gpu llm cuda ggml gptq helm openai python llamacpp langchain kubernetes cloudnative llm-serving llm-inference
This repository has been archived (exclude archived)
Created 2023-05-23
154 commits to main branch, last one 10 months ago
zhouwg
kantv zhouwg
20
133
apache-2.0
7
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
ggml edge-ai llama-cpp ai-learning whisper-cpp ncnn-android ffmpeg-android
Created 2021-05-27
2,986 commits to master branch, last one 6 months ago
zatevakhin
obsidian-local-llm zatevakhin
5
131
mit
4
Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.
ggml llama llamacpp obsidian-md obsidian-plugin
Created 2023-04-30
14 commits to main branch, last one about a year ago
guoriyue
LangCommand guoriyue
5
124
mit
3
LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.
llm ggml llama shell command terminal command-line command-line-tool
Created 2024-10-03
3,950 commits to main branch, last one about a month ago
shubham0204
SmolChat-Android shubham0204
10
113
apache-2.0
4
Running any GGUF SLMs/LLMs locally, on-device in Android
cpp ggml kotlin android llamacpp small-language-models
Created 2024-11-10
33 commits to main branch, last one 4 days ago
sevagh
demucs.cpp sevagh
13
108
mit
5
C++17 port of Demucs v3 (hybrid) and v4 (hybrid transformer) models with ggml and Eigen3
blas ggml piano demucs eigen3 guitar pytorch demixing music-source-separation
Created 2023-11-26
32 commits to main branch, last one 20 days ago
nrl-ai
CustomChar nrl-ai
10
100
unknown
5
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
cpp llm stt tts ggml llama llama-v2 llama-cpp whisper-cpp
Created 2023-07-21
92 commits to master branch, last one about a year ago
rbourgeat
ImpAI rbourgeat
3
56
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion
Created 2023-11-09
31 commits to main branch, last one 10 months ago