35 results found Sort:

148
2.4k
apache-2.0
23
Local AI API Platform
Created 2023-09-11
2,049 commits to dev branch, last one a day ago
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Created 2023-10-17
1,885 commits to main branch, last one 3 months ago
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces,...
Created 2024-04-13
2,436 commits to main branch, last one 5 days ago
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Created 2023-08-12
193 commits to master branch, last one 5 days ago
83
1.1k
apache-2.0
10
Effortlessly run LLM backends, APIs, frontends, and services with one command.
Created 2024-07-27
441 commits to main branch, last one a day ago
77
909
apache-2.0
27
Interface for OuteTTS models.
Created 2024-11-04
98 commits to main branch, last one 6 days ago
43
766
mit
8
Go manage your Ollama models
Created 2024-05-30
167 commits to main branch, last one 21 hours ago
66
643
apache-2.0
13
An open source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI artifact.
Created 2024-02-02
724 commits to main branch, last one a day ago
Practical Llama 3 inference in Java
Created 2024-04-25
41 commits to main branch, last one about a month ago
LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
Created 2023-12-02
98 commits to main branch, last one a day ago
31
463
mit
9
Run AI ✨ assistant locally! with simple API for Node.js πŸš€
Created 2023-03-25
189 commits to main branch, last one 7 months ago
10
378
mit
3
Go library for embedded vector search and semantic embeddings using llama.cpp
Created 2024-09-29
81 commits to main branch, last one 3 months ago
GGUF implementation in C as a library and a tools CLI program
Created 2023-12-24
60 commits to main branch, last one 26 days ago
Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interp...
Created 2024-02-27
318 commits to main branch, last one 2 days ago
llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
Created 2023-04-01
799 commits to main branch, last one a day ago
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
Created 2023-12-14
64 commits to master branch, last one 7 days ago
14
135
agpl-3.0
11
Making offline AI models accessible to all types of edge devices.
Created 2023-04-09
55 commits to main branch, last one about a year ago
Gradio based tool to run opensource LLM models directly from Huggingface
Created 2024-03-28
30 commits to main branch, last one 7 months ago
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Created 2024-05-28
167 commits to main branch, last one 6 days ago
Own your AI, search the web with it🌐😎
Created 2024-07-27
31 commits to main branch, last one 25 days ago
LM inference server implementation based on *.cpp.
Created 2024-06-19
634 commits to main branch, last one 4 days ago
4
58
apache-2.0
3
😈 ImpAI is an advanced role play app using large language and diffusion models.
Created 2023-11-09
31 commits to main branch, last one 11 months ago
llama_dart is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
Created 2024-02-29
204 commits to main branch, last one a day ago
The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX ...
Created 2024-02-13
61 commits to master branch, last one 10 months ago
A utility to inspect, validate, sign and verify machine learning model files.
Created 2024-10-24
67 commits to main branch, last one 2 months ago
Download models from the Ollama library, without Ollama
Created 2024-09-26
6 commits to master branch, last one 2 months ago
5
49
apache-2.0
2
run ollama & gguf easily with a single command
Created 2024-03-30
63 commits to main branch, last one 8 months ago
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
Created 2023-09-08
24 commits to main branch, last one 6 months ago
llm_utils: Basic LLM tools, best practices, and minimal abstraction.
Created 2024-05-26
20 commits to main branch, last one 3 months ago
A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
Created 2023-05-31
2,663 commits to main branch, last one 7 months ago