34 results found Sort:

janhq
cortex.cpp janhq
135
2.2k
apache-2.0
21
Local AI API Platform
gguf onnx llamacpp onnxruntime tensorrt-llm
Created 2023-09-11
1,959 commits to dev branch, last one a day ago
Mobile-Artificial-Intelligence
maid Mobile-Artificial-Intelligence
170
1.5k
mit
32
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
gguf llama llama2 ollama openai android chatbot chatgpt flutter mistral facebook llamacpp local-ai openorca llama-cpp mobile-ai android-ai free-chatgpt large-language-models mobile-artificial-intelligence
Created 2023-10-17
1,885 commits to main branch, last one about a month ago
heshengtao
comfyui_LLM_party heshengtao
102
1.1k
agpl-3.0
11
LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1...
o1 llm ocr vlm dify flux gguf agent linux llama macos omost gemini ollama openai comfyui flowise graphrag workflow gpt-sovits
Created 2024-04-13
2,381 commits to main branch, last one 3 days ago
withcatai
node-llama-cpp withcatai
99
1.1k
mit
14
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
ai gpu llm cuda gguf catai cmake llama metal nodejs vulkan grammar bindings cmake-js embedding llama-cpp json-schema self-hosted function-calling prebuilt-binaries
Created 2023-08-12
184 commits to master branch, last one 15 days ago
edwko
OuteTTS edwko
61
785
apache-2.0
21
Interface for OuteTTS models.
tts gguf llama transformers text-to-speech
Created 2024-11-04
88 commits to main branch, last one 10 days ago
mukel
llama3.java mukel
71
614
mit
27
Practical Llama 3 inference in Java
llm gguf java llms simd genai llama llama3 openai chatgpt llamacpp huggingface transformers llm-inference
Created 2024-04-25
41 commits to main branch, last one 13 days ago
jozu-ai
kitops jozu-ai
61
588
apache-2.0
13
An open source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI artifact.
ai ml code gguf mlops devops models pytorch sklearn datasets kubernetes opensource tensorflow mlops-tools devops-tools hacktoberfest model-serving platform-engineering kubernetes-deployment model-interpretability
Created 2024-02-02
646 commits to main branch, last one a day ago
av
harbor av
43
587
apache-2.0
8
Effortlessly run LLM backends, APIs, frontends, and services with one command.
ai cli llm npm bash exl2 gguf pypi tool local tools docker package container safetensors self-hosted docker-compose
Created 2024-07-27
363 commits to main branch, last one about a month ago
sammcj
gollama sammcj
34
576
mit
9
Go manage your Ollama models
ai llm tui gguf ollama
Created 2024-05-30
149 commits to main branch, last one 13 days ago
withcatai
catai withcatai
30
459
mit
10
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
189 commits to main branch, last one 6 months ago
eastriverlee
LLM.swift eastriverlee
44
426
mit
14
LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
ios llm gguf tvos macos swift watchos visionos llm-inference
Created 2023-12-02
95 commits to main branch, last one 2 months ago
kelindar
search kelindar
10
370
mit
3
Go library for embedded vector search and semantic embeddings using llama.cpp
ai gpu bert gguf simd llamacpp embeddings search-engine vector-search semantic-search
Created 2024-09-29
81 commits to main branch, last one about a month ago
antirez
gguf-tools antirez
16
247
mit
12
GGUF implementation in C as a library and a tools CLI program
ai ml llm gguf
Created 2023-12-24
56 commits to main branch, last one 7 months ago
mgonzs13
llama_ros mgonzs13
27
167
mit
4
llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
cpp gpt llm vlm ggml gguf ros2 llama llava rerank llamacpp llavacpp langchain reranking embeddings
Created 2023-04-01
731 commits to main branch, last one 7 days ago
ShelbyJenkins
llm_client ShelbyJenkins
14
157
mit
4
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
ai llm gguf rust candle
Created 2023-12-14
55 commits to master branch, last one 2 months ago
OE-LUCIFER
Webscout OE-LUCIFER
30
151
other
4
Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interp...
ai ml api g4f free gguf freeai ollama openai python youtube llamacpp localgpt tempmail websearch tempnumber youtube-api openinterpreter text-generation
Created 2024-02-27
299 commits to main branch, last one a day ago
BrutalCoding
shady.ai BrutalCoding
13
129
agpl-3.0
12
Making offline AI models accessible to all types of edge devices.
ios web dart gguf llvm rwkv linux macos android flutter windows fastlane shady-ai llama-cpp serverpod llama-dart whisper-cpp linux-desktop cross-platform material-design
Created 2023-04-09
55 commits to main branch, last one about a year ago
Aesthisia
LLMinator Aesthisia
17
90
mit
5
Gradio based tool to run opensource LLM models directly from Huggingface
cpu llm cuda gguf gradio ollama openai python chatbot llamacpp langchain streaming opensource huggingface safetensors llm-inference websockets-chat llama-cpp-python model-conversion
Created 2024-03-28
30 commits to main branch, last one 6 months ago
AstraBert
PrAIvateSearch AstraBert
10
69
mit
1
Own your AI, search the web with it🌐😎
ai llm gguf docker llamacpp streamlit phi-3-mini open-source web-search-engine local-search-engine
Created 2024-07-27
25 commits to main branch, last one 14 days ago
gpustack
gguf-parser-go gpustack
7
58
mit
5
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
go gguf llama-box llama-cpp stable-diffusion-cpp
Created 2024-05-28
151 commits to main branch, last one 12 days ago
rbourgeat
ImpAI rbourgeat
3
56
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion
Created 2023-11-09
31 commits to main branch, last one 10 months ago
Mobile-Artificial-Intelligence
maid_llm Mobile-Artificial-Intelligence
13
55
mit
5
maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
llm ggml gguf meta gemma llama llama2 mistral mixtral facebook llamacpp local-ai mobile-ai flutter-ai llm-inference
Created 2024-02-29
171 commits to main branch, last one 4 months ago
mikecvet
nl-sh mikecvet
1
54
mit
1
The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX ...
llm gguf rust gpt-4 shell llama2 terminal rust-lang shell-script
Created 2024-02-13
61 commits to master branch, last one 9 months ago
dreadnode
tensor-man dreadnode
1
52
other
2
A utility to inspect, validate, sign and verify machine learning model files.
gguf onnx pytorch safetensors
Created 2024-10-24
67 commits to main branch, last one about a month ago
monk1337
auto-ollama monk1337
5
49
apache-2.0
2
run ollama & gguf easily with a single command
llm gguf lora llama ollama openai mistral autogguf inference mergelora autoollama llm-inference
Created 2024-03-30
63 commits to main branch, last one 7 months ago
gpustack
llama-box gpustack
8
48
mit
4
LM inference server implementation based on llama.cpp.
cpp gguf diffusion transformer openai-compatible-api
Created 2024-06-19
541 commits to main branch, last one a day ago
ahoylabs
gguf.js ahoylabs
1
44
mit
2
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
llm ggml gguf llamacpp machine-learning large-language-models
Created 2023-09-08
24 commits to main branch, last one 4 months ago
akx
ollama-dl akx
5
42
mit
1
Download models from the Ollama library, without Ollama
llm gguf ollama downloader
Created 2024-09-26
6 commits to master branch, last one about a month ago
latestissue
AltaeraAI latestissue
0
41
agpl-3.0
2
A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
ai phi ggml gguf rwkv mamba rwkv4 termux vicuna android mistral rwkvcpp koboldai llamacpp koboldcpp tinyllama tinyvicuna tinydolphin
Created 2023-05-31
2,663 commits to main branch, last one 6 months ago
jndiogo
sibila jndiogo
6
39
mit
3
Extract structured data from local or remote LLM models
ai gpt gguf openai python llamacpp local-ai pydantic dataclasses local-models llm-inference structured-data large-language-models structured-extraction structured-generation
Created 2024-01-31
43 commits to main branch, last one 6 months ago