38 results found Sort:

ggerganov
llama.cpp ggerganov
9.8k
68.1k
mit
548
LLM inference in C/C++
ggml llama
Created 2023-03-10
4,144 commits to master branch, last one 19 hours ago
rustformers
llm rustformers
362
6.1k
apache-2.0
50
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
ai ml llm ggml rust
This repository has been archived (exclude archived)
Created 2023-03-13
1,093 commits to main branch, last one 4 months ago
xorbitsai
inference xorbitsai
441
5.4k
apache-2.0
42
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...
llm ggml glm4 qwen vllm gemma llama llama3 chatglm flan-t5 mistral pytorch whisper llamacpp wizardlm inference deployment openai-api machine-learning artificial-intelligence
Created 2023-06-14
990 commits to main branch, last one a day ago
leejet
stable-diffusion.cpp leejet
305
3.5k
mit
53
Stable Diffusion and Flux in pure C/C++
ai flux ggml img2img txt2img flux-dev cplusplus diffusion text2image image2image flux-schnell image-generation latent-diffusion stable-diffusion
Created 2023-08-13
156 commits to master branch, last one 27 days ago
RWKV
rwkv.cpp RWKV
99
1.4k
mit
22
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
llm ggml rwkv quantization deep-learning language-model machine-learning
Created 2023-03-30
421 commits to master branch, last one 3 months ago
guinmoon
LLMFarm guinmoon
87
1.4k
mit
17
llama and other large language models on iOS and MacOS offline using GGML library.
ai ios ggml rwkv gpt-2 llama macos swift gptneox starcoder
Created 2023-06-14
308 commits to main branch, last one a day ago
RahulSChand
gpu_poor RahulSChand
58
1.2k
unknown
6
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
gpu llm ggml llama llama2 pytorch llamacpp huggingface quantization language-model
Created 2023-09-12
71 commits to main branch, last one 19 days ago
PABannier
bark.cpp PABannier
58
731
mit
38
Suno AI's Bark model in C/C++ for fast text-to-speech generation
tts ggml inference text-to-speech machine-learning
Created 2023-07-01
109 commits to main branch, last one 4 days ago
abacaj
mpt-30B-inference abacaj
94
573
mit
13
Run inference on MPT-30B using CPU
ggml mpt-30b ctransformers
Created 2023-06-26
22 commits to main branch, last one about a year ago
Maknee
minigpt4.cpp Maknee
28
558
mit
9
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
c cpp ggml minigpt4 multimodal quantization deep-learning machine-learning
Created 2023-07-15
15 commits to master branch, last one about a year ago
azkadev
whisper azkadev
34
555
other
13
Whisper Dart is a cross platform library for dart and flutter that allows converting audio to text / speech to text / inference from Open AI models
ai ios dart ggml linux macos openai speech android flutter whisper windows indonesia transcribe transformer whisper-dart speech-to-text whisper-flutter speech-synthesis speech-recognition
Created 2022-10-05
9 commits to main branch, last one 2 months ago
the-crypt-keeper
can-ai-code the-crypt-keeper
30
541
mit
11
Self-evaluating interview for AI coders
ai llm ggml humaneval langchain llama-cpp transformers
Created 2023-05-27
707 commits to main branch, last one 7 days ago
monatis
clip.cpp monatis
32
460
mit
16
CLIP inference in plain C/C++ with no extra dependencies
c cpp clip ggml multimodal image-search
Created 2023-04-28
87 commits to main branch, last one 3 months ago
shm007g
LLaMA-Cult-and-More shm007g
24
427
mit
34
Large Language Models for All, 🦙 Cult and More, Stay in touch !
gpt llm ggml gpt4 gptq llama alpaca vicuna chatgpt loralib pytorch deepspeed tensorflow transformers
Created 2023-03-30
27 commits to main branch, last one about a year ago
azkadev
bark azkadev
3
368
other
4
WIP Library Text To Speech From Suno AI's Bark in C/C++ for fast inference
ai tts bark dart fake ggml clone voice deep-learning neural-network text-to-speech machine-learning
Created 2023-07-16
23 commits to main branch, last one 7 months ago
azkadev
general_ai azkadev
1
308
other
2
GENERAL Ai Library For DART & Flutter
ai ml dart ggml piper azkadev flutter library whisper deep-learning machine-learning stable-diffusion artificial-intelligence
Created 2024-02-24
19 commits to main branch, last one 7 months ago
staghado
vit.cpp staghado
18
233
mit
7
Inference Vision Transformer (ViT) in plain C/C++ with ggml
c ai cpp cpu ggml llamacpp whisper-cpp edge-computing computer-vision vision-transformer image-classification
Created 2023-11-02
110 commits to main branch, last one 9 months ago
mayooear
private-chatbot-mpt30b-langchain mayooear
43
182
mit
4
Chat with your data privately using MPT-30b
gpt llm ggml langchain
Created 2023-06-28
3 commits to main branch, last one about a year ago
mgonzs13
llama_ros mgonzs13
27
159
mit
4
llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
cpp gpt llm vlm ggml gguf ros2 llama llava rerank llamacpp llavacpp langchain reranking embeddings
Created 2023-04-01
679 commits to main branch, last one a day ago
balisujohn
tortoise.cpp balisujohn
16
159
mit
14
A ggml (C++) re-implementation of tortoise-tts
to tts ggml text local speech tortoise-tts text-to-speech
Created 2023-11-25
539 commits to master branch, last one 3 months ago
abacaj
replit-3B-inference abacaj
27
154
mit
3
Run inference on replit-3B code instruct model using CPU
ggml replit replit-code ctransformers
Created 2023-06-27
22 commits to main branch, last one about a year ago
chenhunghan
ialacol chenhunghan
17
142
mit
3
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
ai gpu llm cuda ggml gptq helm openai python llamacpp langchain kubernetes cloudnative llm-serving llm-inference
This repository has been archived (exclude archived)
Created 2023-05-23
154 commits to main branch, last one 9 months ago
gotzmann
booster gotzmann
6
140
other
7
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
gpt llm ggml vllm llama ollama openai chatgpt exllama llamacpp llama-cpp oobabooga
Created 2023-05-04
491 commits to main branch, last one 3 months ago
zatevakhin
obsidian-local-llm zatevakhin
5
128
mit
4
Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.
ggml llama llamacpp obsidian-md obsidian-plugin
Created 2023-04-30
14 commits to main branch, last one about a year ago
zhouwg
kantv zhouwg
20
127
apache-2.0
7
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
ggml edge-ai llama-cpp ai-learning whisper-cpp ncnn-android ffmpeg-android
Created 2021-05-27
2,986 commits to master branch, last one 5 months ago
guoriyue
LangCommand guoriyue
5
111
mit
2
LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.
llm ggml llama shell command terminal command-line command-line-tool
Created 2024-10-03
3,950 commits to main branch, last one 2 days ago
sevagh
demucs.cpp sevagh
13
103
mit
5
C++17 port of Demucs v3 (hybrid) and v4 (hybrid transformer) models with ggml and Eigen3
blas ggml piano demucs eigen3 guitar pytorch demixing music-source-separation
Created 2023-11-26
31 commits to main branch, last one 4 months ago
nrl-ai
CustomChar nrl-ai
9
97
unknown
5
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
cpp llm stt tts ggml llama llama-v2 llama-cpp whisper-cpp
Created 2023-07-21
92 commits to master branch, last one 11 months ago
rbourgeat
ImpAI rbourgeat
3
54
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion
Created 2023-11-09
31 commits to main branch, last one 9 months ago
mgonzs13
whisper_ros mgonzs13
12
51
mit
4
Speech-to-Text based on SileroVAD + whisper.cpp (GGML Whisper) for ROS 2
vad ggml ros2 whisper-cpp speech-to-text speech-recognition voice-activity-detection
Created 2023-05-01
174 commits to main branch, last one 8 days ago