35 results found Sort:

h2oai
h2ogpt h2oai
1.3k
11.5k
apache-2.0
156
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
ai gpt llm pdf llama2 chatgpt gpt4all mixtral private embeddings generative privategpt vectorstore
Created 2023-03-24
7,975 commits to main branch, last one 17 days ago
bigscience-workshop
petals bigscience-workshop
523
9.3k
mit
95
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
gpt nlp bloom llama falcon chatbot guanaco mixtral pytorch transformer deep-learning language-models neural-networks machine-learning pretrained-models tensor-parallelism distributed-systems volunteer-computing pipeline-parallelism large-language-models
Created 2022-06-12
522 commits to main branch, last one 3 months ago
yangjianxin1
Firefly yangjianxin1
532
6.0k
unknown
55
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora qwen2 alpaca aquila llama2 llama3 zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
179 commits to master branch, last one about a month ago
InternLM
xtuner InternLM
322
4.1k
apache-2.0
36
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one about a month ago
aandrew-me
tgpt aandrew-me
182
2.1k
gpl-3.0
39
AI Chatbots in terminal without needing API keys
ai go cli gpt3 linux llama macos golang chatbot chatgpt mixtral windows terminal
Created 2023-04-17
423 commits to main branch, last one 14 days ago
darrenburns
elia darrenburns
120
1.9k
apache-2.0
11
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
ai gpt llm tui gemma llama phi-3 claude llama3 ollama python chatgpt mistral mixtral terminal mistral-ai ollama-client ollama-interface large-language-models
Created 2023-05-04
295 commits to main branch, last one 2 months ago
kevinhermawan
Ollamac kevinhermawan
74
1.4k
other
16
Mac app for Ollama
ai llm llma llms llma2 macos llama3 ollama mistral mixtral
Created 2023-11-04
64 commits to main branch, last one 11 days ago
ymcui
Chinese-Mixtral ymcui
43
589
apache-2.0
15
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
32k 64k llm moe nlp mixtral mixture-of-experts large-language-models
Created 2024-01-11
31 commits to main branch, last one 7 months ago
jianzhnie
LLamaTuner jianzhnie
63
583
apache-2.0
9
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
dpo ppo qwen rlhf llama qlora llama3 chatgpt mixtral
Created 2023-05-25
537 commits to main branch, last one 5 months ago
tenstorrent
tt-metal tenstorrent
88
567
apache-2.0
26
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
ml llm llama metal resnet mistral mixtral accelerator tenstorrent stable-diffusion low-level-programming
Created 2023-02-13
12,352 commits to main branch, last one 10 hours ago
sozercan
aikit sozercan
31
405
mit
8
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
374 commits to main branch, last one 9 days ago
moritztng
fltr moritztng
8
377
mit
6
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
cli llm grep rust llama llama-2 mistral mixtral grep-like localllama mixtral-8x7b operating-system
Created 2023-12-06
92 commits to main branch, last one 9 months ago
helixml
helix helixml
35
371
other
7
Multi-node production GenAI stack. Run the best of open source AI easily on your own servers. Easily add knowledge from documents and scrape websites. Create your own AI by fine-tuning open source mod...
api k8s llm rag helm sdxl llama golang openai mistral mixtral openapi swagger gptscript llm-agent finetuning llm-serving self-hosted function-calling stable-diffusion
Created 2023-10-17
4,389 commits to main branch, last one 8 hours ago
ModelTC
llmc ModelTC
40
365
apache-2.0
9
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
awq llm lvlm tool vllm llama3 quarot mixtral pruning lightllm benchmark internlm2 omniquant spinquant deployment evaluation smoothquant quantization large-language-models post-training-quantization
Created 2024-03-06
421 commits to main branch, last one 2 days ago
WangRongsheng
Aurora WangRongsheng
21
259
apache-2.0
7
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
gpt llm lora qlora chinese mixtral fine-tuning mixtral-8x7b language-model instruction-tuning large-language-models mixtral-8x7b-instruct
Created 2023-12-18
83 commits to main branch, last one 7 months ago
inferflow
inferflow inferflow
24
236
mit
8
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
moe qwen bloom gemma phi-2 falcon llama2 m2m100 minicpm mistral mixtral deepseek internlm llamacpp baichuan2 llm-inference mixture-of-experts model-quantization multi-gpu-inference
Created 2023-12-26
116 commits to main branch, last one 9 months ago
empower-ai
empower-functions empower-ai
19
235
unknown
2
GPT-4 level function calling models for real-world tool using use cases
ai llm llama3 mixtral function-calling
Created 2024-05-10
16 commits to main branch, last one 2 months ago
expectedparrot
edsl expectedparrot
19
206
mit
8
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
llm llama2 openai python mixtral surveys anthropic deepinfra llm-agent experiments open-source data-labeling llm-framework llm-inference social-science synthetic-data market-research domain-specific-language
Created 2024-01-02
4,208 commits to main branch, last one 6 hours ago
Picovoice
picollm Picovoice
8
196
apache-2.0
9
On-device LLM Inference Powered by X-Bit Quantization
llm llms gemma llama llama2 llama3 mistral mixtral compression self-hosted quantization generative-ai llm-inference language-model language-models model-compression efficient-inference large-language-model natural-language-processing
Created 2024-04-09
46 commits to main branch, last one 3 days ago
gbaptista
ollama-ai gbaptista
4
192
mit
6
A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.
ai llm llama llava alpaca llama2 ollama vicuna dolphin mistral mixtral bakllava openorca nano-bots mistral-ai ollama-api
Created 2024-01-06
18 commits to main branch, last one 5 months ago
unifyai
unify unifyai
24
191
apache-2.0
4
Build Your AI Workflow in Seconds ⚡
ai gpt llm llms gpt-4 claude llama2 openai python mixtral llm-inference
Created 2024-03-26
1,148 commits to main branch, last one 2 days ago
babycommando
machinascript-for-robots babycommando
7
165
apache-2.0
10
Build LLM-powered robots in your garage with MachinaScript For Robots!
ai gpt llm llms gpt-3 gpt-4 llama robot llama2 robots arduino mistral mixtral robotics mistral-7b mixtral-8x7b raspberry-pi raspberry-pi-4 artificial-intelligence
Created 2024-01-31
49 commits to main branch, last one 2 months ago
noco-ai
spellbook-docker noco-ai
9
139
osl-3.0
3
AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
bark llama2 xttsv2 mixtral whisper llm-inference text-to-speech musicgeneration stable-diffusion automatic-speech-recognition
Created 2023-11-06
18 commits to master branch, last one 7 months ago
vemonet
libre-chat vemonet
17
136
mit
6
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by LangChain.
llm llama2 chatbot chatgpt mixtral no-code openapi langchain open-source self-hosted llm-inference question-answering large-language-models
Created 2023-07-26
236 commits to main branch, last one about a month ago
marklysze
LlamaIndex-RAG-WSL-CUDA marklysze
12
121
unknown
2
Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
wsl2 gemma phi-2 orca-2 yi-34b llama-2 mixtral gemma-2b gemma-7b neural-7b llamaindex mistral-7b windows-10 windows-11 mixtral-8x7b neural-chat-7b microsoft-phi-2 retrieval-augmented-generation
Created 2023-12-08
22 commits to master branch, last one 10 months ago
trinib
ZORG-Jailbreak-Prompt-Text trinib
13
92
unknown
6
Bypass restricted and censored content on AI chat prompts 😈
ai gpt openai prompt chatbot chatgpt mistral mixtral chat-box jailbreak ai-chatbot ai-chat-bot huggingface gpt-3-5-turbo jailbreak-prompt
This repository has been archived (exclude archived)
Created 2024-03-10
10 commits to main branch, last one 8 months ago
fly-apps
ollama-open-webui fly-apps
22
68
mit
8
Self-host a ChatGPT-style web interface for Ollama 🦙
ai gpu gemma llava llama3 ollama mistral mixtral ollama-webui
Created 2024-02-06
24 commits to main branch, last one 4 months ago
Bes-js
herc.ai Bes-js
23
64
gpl-3.0
1
A powerful library for interacting with the Herc.ai API.
ai api gpt bard bing dalle gpt-4 dall-e gemini openai bard-ai chatbot chatgpt mixtral bing-api chatgpt4 chatgpt-api
Created 2023-06-16
92 commits to main branch, last one 5 months ago
ad-si
cai ad-si
2
64
isc
2
The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!
ai ml cli gpt llm groq rust gpt-4 llama claude gpt-4o llama3 ollama openai prompt chatgpt mistral mixtral anthropic llamafile
Created 2024-03-28
54 commits to main branch, last one 12 days ago
Mobile-Artificial-Intelligence
maid_llm Mobile-Artificial-Intelligence
12
53
mit
5
maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
llm ggml gguf meta gemma llama llama2 mistral mixtral facebook llamacpp local-ai mobile-ai flutter-ai llm-inference
Created 2024-02-29
171 commits to main branch, last one 3 months ago