56 results found Sort:

ollama
ollama ollama
5.7k
75.6k
mit
452
Get up and running with Llama 3, Mistral, Gemma, and other large language models.
go llm llms phi3 gemma llama llava golang llama2 llama3 ollama mistral
Created 2023-06-26
2,989 commits to main branch, last one a day ago
haotian-liu
LLaVA haotian-liu
1.9k
17.7k
apache-2.0
157
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning
Created 2023-04-17
460 commits to main branch, last one about a month ago
Fanghua-Yu
SUPIR Fanghua-Yu
340
3.8k
other
69
SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild
sdxl llava pytorch restoration deep-learning diffusion-models stable-diffusion super-resolution pytorch-lightning
Created 2023-12-21
26 commits to master branch, last one 16 days ago
InternLM
xtuner InternLM
251
3.1k
apache-2.0
31
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
303 commits to main branch, last one 2 days ago
SciSharp
LLamaSharp SciSharp
296
2.2k
mit
52
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
gpt llm llama llava llama2 llama3 chatbot llamacpp llama-cpp multi-modal semantic-kernel
Created 2023-05-09
1,460 commits to master branch, last one 18 hours ago
modelscope
swift modelscope
203
2.1k
apache-2.0
19
ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Phi3-Vision, ...)
awq dpo llm sft glm4 lora peft qwen agent llama llava qwen2 deploy llama3 minicpm unsloth internvl modelscope multimodal pre-training
Created 2023-08-01
667 commits to main branch, last one 10 hours ago
chenking2020
FindTheChatGPTer chenking2020
202
2.0k
unknown
56
ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利
agi codi lora belle ceval linly llama llava alpaca llama2 vicuna autogpt chatglm chatgpt guanaco wizadlm baichuan minigpt4 learderboard self-instruct
Created 2023-04-07
65 commits to main branch, last one 10 months ago
modelscope
data-juicer modelscope
109
1.7k
apache-2.0
14
A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！
gpt llm nlp llms sora gpt-4 llama llava chinese dataset pytorch opendata streamlit multi-modal data-science pre-training data-analysis data-visualization instruction-tuning large-language-models
Created 2023-08-01
173 commits to main branch, last one 10 hours ago
mbzuai-oryx
Video-ChatGPT mbzuai-oryx
92
1.0k
cc-by-4.0
14
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for ...
clip gpt-4 llama llava vicuna chatbot mulit-modal video-chatboat vision-language video-conversation vision-language-pretraining
Created 2023-05-18
42 commits to main branch, last one 10 days ago
roboflow
multimodal-maestro roboflow
71
988
mit
14
Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥
lmm gpt-4 llava cross-modal gpt-4-vision multimodality object-detection segment-anything visual-prompting prompt-engineering instance-segmentation vision-language-model
Created 2023-11-24
71 commits to develop branch, last one 4 months ago
unum-cloud
uform unum-cloud
56
956
apache-2.0
13
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
bert clip llava openai pytorch openclip clustering multimodal transformer image-search multi-lingual vector-search neural-network cross-attention language-vision semantic-search pretrained-models contrastive-learning representation-learning huggingface-transformers
Created 2023-02-21
286 commits to main branch, last one 2 months ago
mbzuai-oryx
LLaVA-pp mbzuai-oryx
48
726
unknown
10
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
llm lmms phi3 llava llama3 llava-phi3 phi3-llava phi-3-llava phi3-vision conversation llama3-llava llava-llama3 phi-3-vision llama-3-llava llama3-vision llama-3-vision vision-language
Created 2024-04-26
11 commits to main branch, last one about a month ago
open-compass
VLMEvalKit open-compass
68
603
apache-2.0
8
Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 50+ HF models, 20+ benchmarks
gpt llm vit vqa clip gpt4 qwen llava claude gemini gpt-4v openai chatgpt pytorch evaluation openai-api multi-modal computer-vision large-language-models
Created 2023-12-01
526 commits to main branch, last one 4 hours ago
SkalskiP
awesome-foundation-and-multimodal-models SkalskiP
40
534
unknown
23
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
nlp blip clip llava multimodal grounding-dino computer-vision image-captioning segment-anything foundational-models zero-shot-detection open-vocabulary-detection open-vocabulary-segmentation
Created 2023-10-08
31 commits to master branch, last one 3 months ago
TinyLLaVA
TinyLLaVA_Factory TinyLLaVA
38
454
apache-2.0
13
A Framework of Small-scale Large Multimodal Models
nlp llama llava tinyllama transformers vision-language large-multimodal-models
Created 2024-02-21
174 commits to main branch, last one 7 days ago
jhc13
taggui jhc13
21
440
gpl-3.0
8
Tag manager and captioner for image datasets
llava cogvlm pyside6 moondream tag-manager image-tagging image-captioning stable-diffusion
Created 2023-03-08
511 commits to main branch, last one 5 days ago
apocas
restai apocas
68
337
apache-2.0
8
RestAI is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex, Ollama and HF Pipelines. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama. Pr...
llm rag llama llava ollama openai python fastapi langchain openaiapi embeddings llamaindex transformers stable-diffusion
Created 2023-05-18
750 commits to master branch, last one 4 days ago
awaescher
OllamaSharp awaescher
42
313
mit
10
Ollama API bindings for .NET
llm lama phi3 gemma llama llava llama2 llama3 ollama mistral ollama-api
Created 2023-10-15
116 commits to main branch, last one a day ago
gokayfem
ComfyUI_VLM_nodes gokayfem
23
288
apache-2.0
7
Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation
llm vlm mllm llava nodes phi15 joytag siglip comfyui img2sfx img2text custom-nodes image-captioning
Created 2024-01-24
228 commits to main branch, last one 24 days ago
developersdigest
ai-devices developersdigest
32
249
mit
3
AI Device Template Featuring Whisper, TTS, Groq, Llama3, OpenAI and more
llm tts groq llava llama3 openai serper whisper langchain langsmith gpt-4-vision function-calling
Created 2024-04-20
42 commits to main branch, last one about a month ago
SALT-NLP
LLaVAR SALT-NLP
12
247
apache-2.0
5
Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
ocr gpt-4 llava chatbot chatgpt multimodal instruction-tuning vision-and-language
Created 2023-06-27
38 commits to main branch, last one 9 months ago
PaddlePaddle
PaddleMIX PaddlePaddle
99
235
apache-2.0
21
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...
dit aigc clip sora blip2 llava sd-xl qwen-vl eva-clip minigpt4 controlnet multimodal ppdiffusers image-to-text text-to-image text-to-video stable-diffusion stablevideodiffusion
Created 2023-07-05
675 commits to develop branch, last one 12 days ago
jakobdylanc
discord-llm-chatbot jakobdylanc
46
235
apache-2.0
3
llmcord.py • Talk to LLMs with your friends!
ai bot gpt llm clyde gpt-4 llama llava gpt-4o llama3 ollama openai chatbot chatgpt discord litellm llmcord llamacpp streamed oobabooga
Created 2023-05-08
199 commits to main branch, last one 21 hours ago
FuxiaoLiu
LRV-Instruction FuxiaoLiu
14
230
bsd-3-clause
11
[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
gpt vqa iclr gpt-4 llama llava vicuna vision chatgpt iclr2024 evaluation multimodal hallucination object-detection foundation-models evaluation-metrics prompt-engineering vision-and-language
Created 2023-06-15
366 commits to main branch, last one 3 months ago
WisconsinAIVision
ViP-LLaVA WisconsinAIVision
15
209
apache-2.0
5
[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
clip gpt-4 llama llava llama2 chatbot cvpr2024 multi-modal gpt-4-vision vision-language visual-prompting foundation-models
Created 2023-12-02
39 commits to main branch, last one 13 days ago
tianyi-lab
HallusionBench tianyi-lab
3
200
bsd-3-clause
4
[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
llm lmm vlms gpt-4 llava gpt-4v benchmark benchmarks hallucination large-language-models large-vision-language-models
Created 2023-10-22
132 commits to main branch, last one 3 months ago
trzy
llava-cpp-server trzy
9
168
mit
5
LLaVA server (llama.cpp).
llm llama llava llama2 multimodal vision-transformer
Created 2023-10-13
26 commits to main branch, last one 8 months ago
gokayfem
awesome-vlm-architectures gokayfem
10
160
cc0-1.0
7
Famous Vision Language Models and Their Architectures
vlm blip clip llava cogvlm kosmos awesome qwen-vl internlm multimodal awesome-list text-encoder image-encoder vision-language-model
Created 2024-02-15
221 commits to main branch, last one 12 days ago
sshh12
multi_token sshh12
8
158
apache-2.0
3
Embed arbitrary modalities (images, audio, documents, etc) into large language models.
llm llava multimodal large-context multi-modality large-language-models vision-language-model large-multimodal-models
Created 2023-10-11
84 commits to main branch, last one 3 months ago
Blaizzy
mlx-vlm Blaizzy
12
138
mit
5
MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.
llm mlx llava idefics local-ai paligemma apple-silicon vision-framework vision-transformer vision-language-model
Created 2024-04-16
142 commits to main branch, last one 2 days ago