Search Results - RepositoryStats

cortex.cpp janhq

125

2.1k

apache-2.0

17

Local AI API Platform

gguf onnx llamacpp onnxruntime tensorrt-llm

Created 2023-09-11

1,878 commits to dev branch, last one a day ago

maid Mobile-Artificial-Intelligence

162

1.5k

mit

31

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Created 2023-10-17

1,885 commits to main branch, last one 18 days ago

comfyui_LLM_party heshengtao

93

1.0k

agpl-3.0

11

LLM Agent Framework in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ol...

Created 2024-04-13

2,275 commits to main branch, last one 4 hours ago

node-llama-cpp withcatai

94

1.0k

mit

12

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Created 2023-08-12

179 commits to master branch, last one 23 days ago

llama3.java mukel

66

580

mit

27

Practical Llama 3 inference in Java

llm gguf java llms simd genai llama llama3 openai chatgpt llamacpp huggingface transformers llm-inference

Created 2024-04-25

34 commits to main branch, last one 9 days ago

harbor av

37

544

apache-2.0

8

Effortlessly run LLM backends, APIs, frontends, and services with one command.

ai cli llm npm bash exl2 gguf pypi tool local tools docker package container safetensors self-hosted docker-compose

Created 2024-07-27

359 commits to main branch, last one 4 days ago

kitops jozu-ai

55

509

apache-2.0

13

An open source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI artifact.

Created 2024-02-02

609 commits to main branch, last one 2 days ago

gollama sammcj

31

498

mit

9

Go manage your Ollama models

ai llm tui gguf ollama

Created 2024-05-30

137 commits to main branch, last one a day ago

catai withcatai

30

455

mit

10

Run AI ✨ assistant locally! with simple API for Node.js 🚀

ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide

Created 2023-03-25

189 commits to main branch, last one 5 months ago

OuteTTS edwko

25

410

apache-2.0

16

Interface for OuteTTS models.

tts gguf llama transformers text-to-speech

Created 2024-11-04

16 commits to main branch, last one 16 days ago

LLM.swift eastriverlee

41

393

mit

14

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

ios llm gguf tvos macos swift watchos visionos llm-inference

Created 2023-12-02

95 commits to main branch, last one about a month ago

search kelindar

7

362

mit

3

Go library for embedded vector search and semantic embeddings using llama.cpp

ai gpu bert gguf simd llamacpp embeddings search-engine vector-search semantic-search

Created 2024-09-29

81 commits to main branch, last one 25 days ago

gguf-tools antirez

13

244

mit

12

GGUF implementation in C as a library and a tools CLI program

ai ml llm gguf

Created 2023-12-24

56 commits to main branch, last one 6 months ago

llama_ros mgonzs13

27

161

mit

4

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

cpp gpt llm vlm ggml gguf ros2 llama llava rerank llamacpp llavacpp langchain reranking embeddings

Created 2023-04-01

695 commits to main branch, last one 20 hours ago

Webscout HelpingAI

23

138

other

4

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interp...

Created 2024-02-27

255 commits to main branch, last one a day ago

llm_client ShelbyJenkins

11

133

mit

4

The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes

ai llm gguf rust candle

Created 2023-12-14

55 commits to master branch, last one about a month ago

shady.ai BrutalCoding

11

127

agpl-3.0

11

Making offline AI models accessible to all types of edge devices.

Created 2023-04-09

55 commits to main branch, last one about a year ago

LLMinator Aesthisia

17

87

mit

4

Gradio based tool to run opensource LLM models directly from Huggingface

cpu llm cuda gguf gradio ollama openai python chatbot llamacpp langchain streaming opensource huggingface safetensors llm-inference websockets-chat llama-cpp-python model-conversion

Created 2024-03-28

30 commits to main branch, last one 4 months ago

ImpAI rbourgeat

3

54

apache-2.0

3

😈 ImpAI is an advanced role play app using large language and diffusion models.

ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion

Created 2023-11-09

31 commits to main branch, last one 9 months ago

nl-sh mikecvet

1

53

mit

1

The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX ...

llm gguf rust gpt-4 shell llama2 terminal rust-lang shell-script

Created 2024-02-13

61 commits to master branch, last one 8 months ago

SearchPhi AstraBert

5

51

mit

1

Open source and AI-powered web search engine: local, private, dockerized and supported by a fluffy llama🦙

ai llm gguf docker llamacpp streamlit phi-3-mini open-source web-search-engine local-search-engine

Created 2024-07-27

21 commits to main branch, last one 3 months ago

maid_llm Mobile-Artificial-Intelligence

12

48

mit

5

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

llm ggml gguf meta gemma llama llama2 mistral mixtral facebook llamacpp local-ai mobile-ai flutter-ai llm-inference

Created 2024-02-29

171 commits to main branch, last one 2 months ago

auto-ollama monk1337

4

48

apache-2.0

2

run ollama & gguf easily with a single command

llm gguf lora llama ollama openai mistral autogguf inference mergelora autoollama llm-inference

Created 2024-03-30

63 commits to main branch, last one 6 months ago

gguf-parser-go gpustack

4

48

mit

5

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

go gguf llama

Created 2024-05-28

140 commits to main branch, last one 2 days ago

gguf.js ahoylabs

1

45

mit

2

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

llm ggml gguf llamacpp machine-learning large-language-models

Created 2023-09-08

24 commits to main branch, last one 3 months ago

tensor-man dreadnode

1

42

other

2

A utility to inspect, validate, sign and verify machine learning model files.

gguf onnx pytorch safetensors

Created 2024-10-24

67 commits to main branch, last one 14 days ago

AltaeraAI latestissue

0

40

agpl-3.0

1

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

ai phi ggml gguf rwkv mamba rwkv4 termux vicuna android mistral rwkvcpp koboldai llamacpp koboldcpp tinyllama tinyvicuna tinydolphin

Created 2023-05-31

2,663 commits to main branch, last one 5 months ago

sibila jndiogo

5

36

mit

3

Extract structured data from local or remote LLM models

ai gpt gguf openai python llamacpp local-ai pydantic dataclasses local-models llm-inference structured-data large-language-models structured-extraction structured-generation

Created 2024-01-31

43 commits to main branch, last one 5 months ago

llm_utils ShelbyJenkins

1

36

mit

3

llm_utils: Basic LLM tools, best practices, and minimal abstraction.

llm nlp gguf rust tokenizer segmentation

Created 2024-05-26

20 commits to main branch, last one about a month ago

ollama-dl akx

4

34

mit

1

Download models from the Ollama library, without Ollama

llm gguf ollama downloader

Created 2024-09-26

6 commits to master branch, last one 9 days ago