Search Results - RepositoryStats

cortex.cpp janhq

116

2.1k

apache-2.0

16

Local AI API Platform

gguf onnx llamacpp onnxruntime tensorrt-llm

Created 2023-09-11

1,784 commits to dev branch, last one 14 hours ago

maid Mobile-Artificial-Intelligence

162

1.5k

mit

30

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Created 2023-10-17

1,885 commits to main branch, last one 2 days ago

node-llama-cpp withcatai

91

975

mit

12

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Created 2023-08-12

179 commits to master branch, last one 7 days ago

comfyui_LLM_party heshengtao

93

975

agpl-3.0

10

Dify in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ollama, grok, qwe...

Created 2024-04-13

2,193 commits to main branch, last one 17 hours ago

llama3.java mukel

62

558

mit

25

Practical Llama 3 inference in Java

llm gguf java llms simd genai llama llama3 openai chatgpt llamacpp huggingface transformers llm-inference

Created 2024-04-25

27 commits to main branch, last one 17 days ago

harbor av

29

483

apache-2.0

8

Effortlessly run LLM backends, APIs, frontends, and services with one command.

ai cli llm npm bash exl2 gguf pypi tool local tools docker package container safetensors self-hosted docker-compose

Created 2024-07-27

331 commits to main branch, last one 4 days ago

kitops jozu-ai

51

469

apache-2.0

13

Securely share and store AI/ML projects as OCI artifacts in your container registry.

Created 2024-02-02

599 commits to main branch, last one 7 hours ago

gollama sammcj

29

459

mit

9

Go manage your Ollama models

ai llm tui gguf ollama

Created 2024-05-30

134 commits to main branch, last one 10 days ago

catai withcatai

30

453

mit

10

Run AI ✨ assistant locally! with simple API for Node.js 🚀

ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide

Created 2023-03-25

189 commits to main branch, last one 4 months ago

LLM.swift eastriverlee

40

376

mit

14

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

ios llm gguf tvos macos swift watchos visionos llm-inference

Created 2023-12-02

95 commits to main branch, last one 18 days ago

search kelindar

6

338

mit

2

Go library for embedded vector search and semantic embeddings using llama.cpp

ai gpu bert gguf simd llamacpp embeddings search-engine vector-search semantic-search

Created 2024-09-29

81 commits to main branch, last one 9 days ago

gguf-tools antirez

13

242

mit

12

GGUF implementation in C as a library and a tools CLI program

ai ml llm gguf

Created 2023-12-24

56 commits to main branch, last one 5 months ago

OuteTTS edwko

10

224

apache-2.0

11

Interface for OuteTTS models.

tts gguf llama transformers text-to-speech

Created 2024-11-04

16 commits to main branch, last one 11 hours ago

llama_ros mgonzs13

27

153

mit

4

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

cpp gpt llm vlm ggml gguf ros2 llama llava rerank llamacpp llavacpp langchain reranking embeddings

Created 2023-04-01

655 commits to main branch, last one a day ago

llm_client ShelbyJenkins

11

131

mit

4

The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes

ai llm gguf rust candle

Created 2023-12-14

55 commits to master branch, last one 13 days ago

shady.ai BrutalCoding

11

127

agpl-3.0

11

Making offline AI models accessible to all types of edge devices.

Created 2023-04-09

55 commits to main branch, last one 12 months ago

Webscout HelpingAI

20

124

other

4

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interp...

Created 2024-02-27

249 commits to main branch, last one 5 days ago

LLMinator Aesthisia

17

87

mit

4

Gradio based tool to run opensource LLM models directly from Huggingface

cpu llm cuda gguf gradio ollama openai python chatbot llamacpp langchain streaming opensource huggingface safetensors llm-inference websockets-chat llama-cpp-python model-conversion

Created 2024-03-28

30 commits to main branch, last one 4 months ago

ImpAI rbourgeat

3

54

apache-2.0

3

😈 ImpAI is an advanced role play app using large language and diffusion models.

ai llm chat game ggml gguf linux llama macos docker windows roleplay llama-cpp character-ai stable-diffusion

Created 2023-11-09

31 commits to main branch, last one 8 months ago

nl-sh mikecvet

1

53

mit

1

The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX ...

llm gguf rust gpt-4 shell llama2 terminal rust-lang shell-script

Created 2024-02-13

61 commits to master branch, last one 7 months ago

SearchPhi AstraBert

5

50

mit

1

Open source and AI-powered web search engine: local, private, dockerized and supported by a fluffy llama🦙

ai llm gguf docker llamacpp streamlit phi-3-mini open-source web-search-engine local-search-engine

Created 2024-07-27

21 commits to main branch, last one 3 months ago

auto-ollama monk1337

4

47

apache-2.0

2

run ollama & gguf easily with a single command

llm gguf lora llama ollama openai mistral autogguf inference mergelora autoollama llm-inference

Created 2024-03-30

63 commits to main branch, last one 5 months ago

maid_llm Mobile-Artificial-Intelligence

12

47

mit

5

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

llm ggml gguf meta gemma llama llama2 mistral mixtral facebook llamacpp local-ai mobile-ai flutter-ai llm-inference

Created 2024-02-29

171 commits to main branch, last one 2 months ago

gguf.js ahoylabs

1

44

mit

2

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

llm ggml gguf llamacpp machine-learning large-language-models

Created 2023-09-08

24 commits to main branch, last one 3 months ago

gguf-parser-go gpustack

4

40

mit

4

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

go gguf llama

Created 2024-05-28

130 commits to main branch, last one 14 days ago

AltaeraAI latestissue

0

39

agpl-3.0

1

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

ai phi ggml gguf rwkv mamba rwkv4 termux vicuna android mistral rwkvcpp koboldai llamacpp koboldcpp tinyllama tinyvicuna tinydolphin

Created 2023-05-31

2,663 commits to main branch, last one 4 months ago

tensor-man dreadnode

0

39

other

2

A utility to inspect, validate, sign and verify machine learning model files.

gguf onnx pytorch safetensors

Created 2024-10-24

61 commits to main branch, last one 5 days ago

sibila jndiogo

5

35

mit

3

Extract structured data from local or remote LLM models

ai gpt gguf openai python llamacpp local-ai pydantic dataclasses local-models llm-inference structured-data large-language-models structured-extraction structured-generation

Created 2024-01-31

43 commits to main branch, last one 4 months ago

llm_utils ShelbyJenkins

1

35

mit

3

llm_utils: Basic LLM tools, best practices, and minimal abstraction.

llm nlp gguf rust tokenizer segmentation

Created 2024-05-26

20 commits to main branch, last one 27 days ago

llama-cpp-chat-memory ossirytk

6

29

unlicense

3

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

ner gguf spacy llama2 chatbot chainlit chromadb llama-cpp langchain-python llama-cpp-python

Created 2023-09-23

63 commits to main branch, last one about a month ago