65 results found Sort:

ollama
ollama ollama
7.8k
97.8k
mit
587
Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.
go llm llms phi3 gemma llama llava gemma2 golang llama2 llama3 ollama mistral
Created 2023-06-26
3,602 commits to main branch, last one 12 hours ago
haotian-liu
LLaVA haotian-liu
2.2k
20.2k
apache-2.0
157
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning
Created 2023-04-17
460 commits to main branch, last one 6 months ago
sgl-project
sglang sgl-project
503
6.0k
apache-2.0
56
SGLang is a fast serving framework for large language models and vision language models.
llm moe vlm cuda llama llava llama2 llama3 pytorch llama3-1 inference llm-serving transformer
Created 2024-01-08
1,219 commits to main branch, last one 13 hours ago
Fanghua-Yu
SUPIR Fanghua-Yu
384
4.4k
other
65
SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild. Our new online demo is also released at suppixel.ai.
sdxl llava pytorch restoration deep-learning diffusion-models stable-diffusion super-resolution pytorch-lightning
Created 2023-12-21
36 commits to master branch, last one 3 months ago
modelscope
ms-swift modelscope
373
4.2k
apache-2.0
23
Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...
dpo llm sft lora peft agent liger llama llava qwen2 deploy llama3 internvl megatron qwen2-vl minicpm-v modelscope multimodal reflection pre-training
Created 2023-08-01
1,163 commits to main branch, last one 21 hours ago
InternLM
xtuner InternLM
309
4.0k
apache-2.0
34
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one 7 days ago
modelscope
data-juicer modelscope
175
2.9k
apache-2.0
19
A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！
gpt llm nlp llms sora gpt-4 llama llava chinese dataset pytorch opendata streamlit multi-modal data-science pre-training data-analysis data-visualization instruction-tuning large-language-models
Created 2023-08-01
244 commits to main branch, last one 2 days ago
SciSharp
LLamaSharp SciSharp
347
2.7k
mit
56
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
gpt llm llama llava llama2 llama3 chatbot llamacpp llama-cpp multi-modal semantic-kernel
Created 2023-05-09
1,726 commits to master branch, last one 20 hours ago
chenking2020
FindTheChatGPTer chenking2020
201
2.0k
unknown
57
ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利
agi codi lora belle ceval linly llama llava alpaca llama2 vicuna autogpt chatglm chatgpt guanaco wizadlm baichuan minigpt4 learderboard self-instruct
Created 2023-04-07
65 commits to main branch, last one about a year ago
open-compass
VLMEvalKit open-compass
188
1.3k
apache-2.0
10
Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
gpt llm vit vqa clip gpt4 qwen llava claude gemini gpt-4v openai chatgpt pytorch evaluation openai-api multi-modal computer-vision large-language-models
Created 2023-12-01
1,006 commits to main branch, last one 23 hours ago
mbzuai-oryx
Video-ChatGPT mbzuai-oryx
108
1.2k
cc-by-4.0
15
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for ...
clip gpt-4 llama llava vicuna chatbot mulit-modal video-chatboat vision-language video-conversation vision-language-pretraining
Created 2023-05-18
43 commits to main branch, last one 2 months ago
unum-cloud
uform unum-cloud
62
1.0k
apache-2.0
15
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
bert clip llava openai pytorch openclip clustering multimodal transformer image-search multi-lingual vector-search neural-network cross-attention language-vision semantic-search pretrained-models contrastive-learning representation-learning huggingface-transformers
Created 2023-02-21
293 commits to main branch, last one about a month ago
mbzuai-oryx
LLaVA-pp mbzuai-oryx
60
810
unknown
10
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
llm lmms phi3 llava llama3 llava-phi3 phi3-llava phi-3-llava phi3-vision conversation llama3-llava llava-llama3 phi-3-vision llama-3-llava llama3-vision llama-3-vision vision-language
Created 2024-04-26
11 commits to main branch, last one 6 months ago
jhc13
taggui jhc13
35
749
gpl-3.0
13
Tag manager and captioner for image datasets
llava cogvlm pyside6 florence-2 tag-manager image-tagging image-captioning stable-diffusion
Created 2023-03-08
530 commits to main branch, last one 13 days ago
PsyChip
machina PsyChip
28
691
unknown
2
OpenCV+YOLO+LLAVA powered video surveillance system
rtsp yolo llava camera opencv python ollama-api
Created 2024-10-07
13 commits to main branch, last one 24 days ago
TinyLLaVA
TinyLLaVA_Factory TinyLLaVA
66
647
apache-2.0
12
A Framework of Small-scale Large Multimodal Models
nlp llama llava tinyllama transformers vision-language large-multimodal-models
Created 2024-02-21
211 commits to main branch, last one 29 days ago
SkalskiP
awesome-foundation-and-multimodal-models SkalskiP
44
572
unknown
26
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
nlp blip clip llava multimodal grounding-dino computer-vision image-captioning segment-anything foundational-models zero-shot-detection open-vocabulary-detection open-vocabulary-segmentation
Created 2023-10-08
31 commits to master branch, last one 8 months ago
NVlabs
EAGLE NVlabs
44
538
apache-2.0
32
EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders
llm lmm demo gpt4 lvlm mllm eagle llama llava nvdia llama3 huggingface large-language-models
Created 2024-06-27
81 commits to main branch, last one about a month ago
Blaizzy
mlx-vlm Blaizzy
41
489
mit
6
MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.
llm mlx llava idefics local-ai paligemma apple-silicon vision-framework vision-transformer vision-language-model
Created 2024-04-16
163 commits to main branch, last one a day ago
gokayfem
awesome-vlm-architectures gokayfem
23
416
cc0-1.0
12
Famous Vision Language Models and Their Architectures
vlm blip clip llava cogvlm kosmos awesome qwen-vl internlm multimodal awesome-list text-encoder image-encoder vision-language-model
Created 2024-02-15
231 commits to main branch, last one 2 months ago
nrl-ai
llama-assistant nrl-ai
31
414
gpl-3.0
7
AI-powered assistant to help you with your daily tasks, powered by Llama 3.2. It can recognize your voice, process natural language, and perform various actions based on your commands: summarizing tex...
owen llama llava llama3 llama-3-2 moondream private-gpt personal-assistant
Created 2024-09-26
62 commits to main branch, last one about a month ago
gokayfem
ComfyUI_VLM_nodes gokayfem
36
412
apache-2.0
7
Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation
llm vlm mllm llava nodes phi15 joytag siglip comfyui img2sfx img2text custom-nodes image-captioning
Created 2024-01-24
271 commits to main branch, last one 9 days ago
xiaoachen98
Open-LLaVA-NeXT xiaoachen98
20
391
unknown
13
An open-source implementation for training LLaVA-NeXT.
gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning
Created 2024-05-11
36 commits to master branch, last one 23 days ago
apocas
restai apocas
74
386
apache-2.0
10
RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precis...
llm rag llama llava ollama openai python fastapi langchain openaiapi embeddings llamaindex transformers stable-diffusion
Created 2023-05-18
798 commits to master branch, last one 21 hours ago
jakobdylanc
llmcord jakobdylanc
68
362
mit
4
A Discord LLM chat bot that supports any OpenAI compatible API (OpenAI, xAI, Mistral, Groq, OpenRouter, Ollama, LM Studio and more)
bot gpt llm xai grok groq gpt-4 llama llava gpt-4o llama3 ollama openai chatbot chatgpt discord mistral lmstudio oobabooga
Created 2023-05-08
326 commits to main branch, last one 12 hours ago
PaddlePaddle
PaddleMIX PaddlePaddle
133
352
apache-2.0
22
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...
dit aigc clip sora llava sd-xl qwen-vl eva-clip minigpt4 qwen2-vl internvl2 controlnet multimodal ppdiffusers unidiffuser image-to-text text-to-image text-to-video stable-diffusion stablevideodiffusion
Created 2023-07-05
909 commits to develop branch, last one a day ago
InternLM
InternEvo InternLM
52
309
apache-2.0
10
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism
Created 2024-01-16
478 commits to develop branch, last one 17 days ago
WisconsinAIVision
ViP-LLaVA WisconsinAIVision
21
294
apache-2.0
5
[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
clip gpt-4 llama llava llama2 chatbot cvpr2024 multi-modal gpt-4-vision vision-language visual-prompting foundation-models
Created 2023-12-02
44 commits to main branch, last one 4 months ago
developersdigest
ai-devices developersdigest
40
279
mit
3
AI Device Template Featuring Whisper, TTS, Groq, Llama3, OpenAI and more
llm tts groq llava llama3 openai serper whisper langchain langsmith gpt-4-vision function-calling
Created 2024-04-20
42 commits to main branch, last one 6 months ago
SALT-NLP
LLaVAR SALT-NLP
12
258
apache-2.0
5
Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
ocr gpt-4 llava chatbot chatgpt multimodal instruction-tuning vision-and-language
Created 2023-06-27
38 commits to main branch, last one about a year ago