35 results found Sort:

h2oai
h2ogpt h2oai
1.3k
11.4k
apache-2.0
157
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
ai gpt llm pdf llama2 chatgpt gpt4all mixtral private embeddings generative privategpt vectorstore
Created 2023-03-24
7,973 commits to main branch, last one 2 days ago
bigscience-workshop
petals bigscience-workshop
525
9.2k
mit
95
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
gpt nlp bloom llama falcon chatbot guanaco mixtral pytorch transformer deep-learning language-models neural-networks machine-learning pretrained-models tensor-parallelism distributed-systems volunteer-computing pipeline-parallelism large-language-models
Created 2022-06-12
522 commits to main branch, last one 2 months ago
yangjianxin1
Firefly yangjianxin1
526
5.9k
unknown
56
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora qwen2 alpaca aquila llama2 llama3 zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
179 commits to master branch, last one 28 days ago
InternLM
xtuner InternLM
311
4.0k
apache-2.0
34
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one 13 days ago
aandrew-me
tgpt aandrew-me
172
2.0k
gpl-3.0
38
AI Chatbots in terminal without needing API keys
ai go cli gpt3 linux llama macos golang chatbot chatgpt mixtral windows terminal
Created 2023-04-17
418 commits to main branch, last one 11 days ago
darrenburns
elia darrenburns
115
1.9k
apache-2.0
10
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
ai gpt llm tui gemma llama phi-3 claude llama3 ollama python chatgpt mistral mixtral terminal mistral-ai ollama-client ollama-interface large-language-models
Created 2023-05-04
295 commits to main branch, last one about a month ago
kevinhermawan
Ollamac kevinhermawan
71
1.3k
other
16
Mac app for Ollama
ai llm llma llms llma2 macos llama3 ollama mistral mixtral
Created 2023-11-04
63 commits to main branch, last one 3 months ago
ymcui
Chinese-Mixtral ymcui
43
584
apache-2.0
15
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
32k 64k llm moe nlp mixtral mixture-of-experts large-language-models
Created 2024-01-11
31 commits to main branch, last one 6 months ago
jianzhnie
LLamaTuner jianzhnie
63
576
apache-2.0
9
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
dpo ppo qwen rlhf llama qlora llama3 chatgpt mixtral
Created 2023-05-25
537 commits to main branch, last one 4 months ago
tenstorrent
tt-metal tenstorrent
75
476
apache-2.0
20
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
ml llm llama metal resnet mistral mixtral accelerator tenstorrent stable-diffusion low-level-programming
Created 2023-02-13
11,798 commits to main branch, last one 17 hours ago
sozercan
aikit sozercan
29
393
mit
6
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
ai gpt llm gemma llama docker nvidia openai chatgpt mistral mixtral buildkit open-llm inference finetuning kubernetes localllama fine-tuning open-source-llm large-language-models
Created 2023-09-20
341 commits to main branch, last one 11 days ago
moritztng
fltr moritztng
7
374
mit
6
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
cli llm grep rust llama llama-2 mistral mixtral grep-like localllama mixtral-8x7b operating-system
Created 2023-12-06
92 commits to main branch, last one 8 months ago
helixml
helix helixml
29
348
other
7
Multi-node production GenAI stack. Run the best of open source AI easily on your own servers. Easily add knowledge from documents and scrape websites. Create your own AI by fine-tuning open source mod...
api k8s llm rag helm sdxl llama golang openai mistral mixtral openapi swagger gptscript llm-agent finetuning llm-serving self-hosted function-calling stable-diffusion
Created 2023-10-17
4,220 commits to main branch, last one 20 hours ago
ModelTC
llmc ModelTC
34
324
apache-2.0
9
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
awq llm lvlm tool vllm llama3 quarot mixtral pruning lightllm benchmark internlm2 omniquant spinquant deployment evaluation smoothquant quantization large-language-models post-training-quantization
Created 2024-03-06
365 commits to main branch, last one 23 hours ago
WangRongsheng
Aurora WangRongsheng
21
257
apache-2.0
7
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
gpt llm lora qlora chinese mixtral fine-tuning mixtral-8x7b language-model instruction-tuning large-language-models mixtral-8x7b-instruct
Created 2023-12-18
83 commits to main branch, last one 6 months ago
inferflow
inferflow inferflow
24
236
mit
8
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
moe qwen bloom gemma phi-2 falcon llama2 m2m100 minicpm mistral mixtral deepseek internlm llamacpp baichuan2 llm-inference mixture-of-experts model-quantization multi-gpu-inference
Created 2023-12-26
116 commits to main branch, last one 8 months ago
empower-ai
empower-functions empower-ai
18
215
unknown
1
GPT-4 level function calling models for real-world tool using use cases
ai llm llama3 mixtral function-calling
Created 2024-05-10
16 commits to main branch, last one about a month ago
expectedparrot
edsl expectedparrot
19
191
mit
8
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
llm llama2 openai python mixtral surveys anthropic deepinfra llm-agent experiments open-source data-labeling llm-framework llm-inference social-science synthetic-data market-research domain-specific-language
Created 2024-01-02
3,805 commits to main branch, last one 3 days ago
Picovoice
picollm Picovoice
7
189
apache-2.0
8
On-device LLM Inference Powered by X-Bit Quantization
llm llms gemma llama llama2 llama3 mistral mixtral compression self-hosted quantization generative-ai llm-inference language-model language-models model-compression efficient-inference large-language-model natural-language-processing
Created 2024-04-09
42 commits to main branch, last one 6 days ago
unifyai
unify unifyai
24
186
apache-2.0
4
LLMs Run Riot in Production. Get Back in The Driving Seat. Build Your Own Evals, Iterate Quickly, and Go from Prototype to Production in No Time ⚡
ai gpt llm llms gpt-4 claude llama2 openai python mixtral llm-inference
Created 2024-03-26
1,127 commits to main branch, last one 12 days ago
gbaptista
ollama-ai gbaptista
4
184
mit
6
A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.
ai llm llama llava alpaca llama2 ollama vicuna dolphin mistral mixtral bakllava openorca nano-bots mistral-ai ollama-api
Created 2024-01-06
18 commits to main branch, last one 4 months ago
babycommando
machinascript-for-robots babycommando
7
164
apache-2.0
9
Build LLM-powered robots in your garage with MachinaScript For Robots!
ai gpt llm llms gpt-3 gpt-4 llama robot llama2 robots arduino mistral mixtral robotics mistral-7b mixtral-8x7b raspberry-pi raspberry-pi-4 artificial-intelligence
Created 2024-01-31
49 commits to main branch, last one about a month ago
noco-ai
spellbook-docker noco-ai
9
139
osl-3.0
3
AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
bark llama2 xttsv2 mixtral whisper llm-inference text-to-speech musicgeneration stable-diffusion automatic-speech-recognition
Created 2023-11-06
18 commits to master branch, last one 6 months ago
vemonet
libre-chat vemonet
17
132
mit
5
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by LangChain.
llm llama2 chatbot chatgpt mixtral no-code openapi langchain open-source self-hosted llm-inference question-answering large-language-models
Created 2023-07-26
236 commits to main branch, last one 8 days ago
marklysze
LlamaIndex-RAG-WSL-CUDA marklysze
13
119
unknown
2
Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
wsl2 gemma phi-2 orca-2 yi-34b llama-2 mixtral gemma-2b gemma-7b neural-7b llamaindex mistral-7b windows-10 windows-11 mixtral-8x7b neural-chat-7b microsoft-phi-2 retrieval-augmented-generation
Created 2023-12-08
22 commits to master branch, last one 9 months ago
trinib
ZORG-Jailbreak-Prompt-Text trinib
13
86
unknown
6
Bypass restricted and censored content on AI chat prompts 😈
ai gpt openai prompt chatbot chatgpt mistral mixtral chat-box jailbreak ai-chatbot ai-chat-bot huggingface gpt-3-5-turbo jailbreak-prompt
This repository has been archived (exclude archived)
Created 2024-03-10
10 commits to main branch, last one 7 months ago
Bes-js
herc.ai Bes-js
23
66
gpl-3.0
1
A powerful library for interacting with the Herc.ai API.
ai api gpt bard bing dalle gpt-4 dall-e gemini openai bard-ai chatbot chatgpt mixtral bing-api chatgpt4 chatgpt-api
Created 2023-06-16
92 commits to main branch, last one 4 months ago
ad-si
cai ad-si
2
62
isc
3
The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!
ai ml cli gpt llm groq rust gpt-4 llama claude gpt-4o llama3 ollama openai prompt chatgpt mistral mixtral anthropic llamafile
Created 2024-03-28
36 commits to main branch, last one 2 months ago
fly-apps
ollama-open-webui fly-apps
20
61
mit
8
Self-host a ChatGPT-style web interface for Ollama 🦙
ai gpu gemma llava llama3 ollama mistral mixtral ollama-webui
Created 2024-02-06
24 commits to main branch, last one 3 months ago
ventz
easy-llms ventz
6
48
mit
4
Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama
aws ai21 llms azure claude cohere google llama3 ollama openai bedrock mistral mixtral claude-3 langchain gemini-pro amazon-titan azure-openai google-vertex-ai langchain-python
Created 2024-06-05
15 commits to main branch, last one 2 months ago