Search Results - RepositoryStats

2.3k

20.8k

apache-2.0

157

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning

Created 2023-04-17

460 commits to main branch, last one 7 months ago

Otter Luodian

243

3.6k

mit

100

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

gpt-4 chatgpt embodied-ai deep-learning multi-modality machine-learning foundation-models instruction-tuning large-scale-models artificial-inteligence visual-language-learning

Created 2023-04-01

626 commits to main branch, last one 9 months ago

NExT-GPT NExT-GPT

341

3.4k

bsd-3-clause

60

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

llm gpt-4 chatgpt multimodal foundation-models instruction-tuning multi-modal-chatgpt large-language-models visual-language-learning

Created 2023-08-30

249 commits to main branch, last one about a month ago

InternLM-XComposer InternLM

159

2.7k

apache-2.0

43

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

409 commits to main branch, last one 3 days ago

Open-LLaVA-NeXT xiaoachen98

20

401

unknown

13

An open-source implementation for training LLaVA-NeXT.

gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning

Created 2024-05-11

36 commits to master branch, last one about a month ago

BLIVA mlpc-ucsd

28

271

bsd-3-clause

12

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

llm lora blip2 bliva llama chatbot multimodal instruction-tuning visual-language-learning

Created 2023-08-02

26 commits to main branch, last one 8 months ago

RLHF-V RLHF-V

6

250

unknown

2

[CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback

gpt-4 llama rlhf-v chatbot multimodal multi-modality visual-language-learning

Created 2023-11-29

73 commits to main branch, last one 3 months ago

KarmaVLM thomas-yanxin

3

84

apache-2.0

1

🧘🏻‍♂️KarmaVLM (相生)：A family of high efficiency and powerful visual language model.

vlm llava qwen2 llama2 multimodel vision-language-model visual-language-learning

Created 2024-01-23

45 commits to main branch, last one 7 months ago

llama-multimodal-vqa AdrianBZG

9

42

mit

1

Multimodal Instruction Tuning for Llama 3

vqa gpt-4 llama llama2 llama3 chatbot chatgpt multimodal huggingface language-models instruction-tuning visual-language-learning visual-question-answering multimodal-instruction-tuning

Created 2024-04-22

4 commits to main branch, last one 7 months ago