Search Results - RepositoryStats

cortex janhq

94

1.8k

unknown

14

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

ai llm cuda gguf llms llama llama2 llamacpp openai-api accelerated tensorrt-llm inference-engine stable-diffusion

Created 2023-09-11

1,130 commits to dev branch, last one a day ago

maid Mobile-Artificial-Intelligence

97

1k

mit

22

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Created 2023-10-17

1,642 commits to main branch, last one a day ago

node-llama-cpp withcatai

61

723

mit

9

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

ai llm cuda gguf catai cmake llama metal nodejs grammar bindings cmake-js llama-cpp json-schema self-hosted prebuilt-binaries

Created 2023-08-12

69 commits to master branch, last one 7 days ago

catai withcatai

27

422

mit

10

Run AI ✨ assistant locally! with simple API for Node.js 🚀

ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide

Created 2023-03-25

189 commits to main branch, last one 7 days ago

LLM.swift eastriverlee

25

277

mit

11

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

ios llm gguf tvos macos swift watchos visionos llm-inference

Created 2023-12-02

85 commits to main branch, last one 21 days ago

kitops jozu-ai

26

266

apache-2.0

12

Tools for easing the handoff between AI/ML and App/SRE teams.

ai ml code gguf mlops devops models pytorch sklearn datasets kubernetes tensorflow mlops-tools devops-tools model-packer model-serving kubernetes-deployment model-interpretability

Created 2024-02-02

420 commits to main branch, last one a day ago

gguf-tools antirez

12

223

mit

11

GGUF implementation in C as a library and a tools CLI program

ai ml llm gguf

Created 2023-12-24

56 commits to main branch, last one about a month ago

gollama sammcj

11

181

mit

5

Go manage your Ollama models

ai llm tui gguf ollama

Created 2024-05-30

77 commits to main branch, last one 5 days ago

shady.ai BrutalCoding

10

111

agpl-3.0

8

Making offline AI models accessible to all types of edge devices.

Created 2023-04-09

55 commits to main branch, last one 7 months ago

llama_ros mgonzs13

15

105

mit

3

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

cpp gpt llm vlm ggml gguf ros2 llama llava llamacpp llavacpp

Created 2023-04-01

427 commits to main branch, last one a day ago

LLMinator Aesthisia

13

75

mit

4

Gradio based tool to run opensource LLM models directly from Huggingface

cpu llm cuda gguf gradio ollama openai python chatbot llamacpp langchain streaming opensource huggingface safetensors llm-inference websockets-chat llama-cpp-python model-conversion

Created 2024-03-28

30 commits to main branch, last one 2 days ago

ImpAI rbourgeat

3

48

apache-2.0

3

😈 ImpAI is an advanced role play app using large language and diffusion models.

ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion

Created 2023-11-09

31 commits to main branch, last one 4 months ago

nl-sh mikecvet

1

47

mit

1

The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX ...

llm gguf rust gpt-4 shell llama2 terminal rust-lang shell-script

Created 2024-02-13

61 commits to master branch, last one 3 months ago

auto-ollama monk1337

4

41

apache-2.0

2

run ollama & gguf easily with a single command

llm gguf lora llama ollama openai mistral autogguf inference mergelora autoollama llm-inference

Created 2024-03-30

63 commits to main branch, last one about a month ago

gguf.js ahoylabs

1

39

mit

2

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

llm ggml gguf llamacpp machine-learning large-language-models

Created 2023-09-08

20 commits to main branch, last one 4 days ago

AltaeraAI latestissue

0

34

agpl-3.0

1

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

ai phi ggml gguf rwkv mamba rwkv4 termux vicuna android mistral rwkvcpp koboldai llamacpp koboldcpp tinyllama tinyvicuna tinydolphin

Created 2023-05-31

2,663 commits to main branch, last one 7 days ago

Webscout OE-LUCIFER

3

33

other

3

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interp...

Created 2024-02-27

181 commits to main branch, last one 21 hours ago

py.gpt.prompt teleprint-me

5

28

other

1

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

ggml gguf openai python chatgpt cli-app chromadb llamacpp huggingface prompt-toolkit developer-tools

This repository has been archived (exclude archived)

Created 2023-05-15

1,064 commits to main branch, last one about a month ago

llama-cpp-chat-memory ossirytk

4

27

unlicense

3

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

ner gguf spacy llama2 chatbot chainlit chromadb llama-cpp langchain-python llama-cpp-python

Created 2023-09-23

51 commits to main branch, last one 21 days ago

maid_llm Mobile-Artificial-Intelligence

7

26

mit

5

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

llm ggml gguf meta gemma llama llama2 mistral mixtral facebook llamacpp local-ai mobile-ai flutter-ai llm-inference

Created 2024-02-29

163 commits to main branch, last one 2 days ago