Search Results - RepositoryStats

2.1k

19.5k

apache-2.0

160

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning

Created 2023-04-17

460 commits to main branch, last one 4 months ago

Otter Luodian

242

3.6k

mit

100

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

gpt-4 chatgpt embodied-ai deep-learning multi-modality machine-learning foundation-models instruction-tuning large-scale-models artificial-inteligence visual-language-learning

Created 2023-04-01

626 commits to main branch, last one 6 months ago

NExT-GPT NExT-GPT

319

3.2k

bsd-3-clause

57

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

llm gpt-4 chatgpt multimodal foundation-models instruction-tuning multi-modal-chatgpt large-language-models visual-language-learning

Created 2023-08-30

225 commits to main branch, last one 8 months ago

InternLM-XComposer InternLM

153

2.5k

apache-2.0

41

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

394 commits to main branch, last one 29 days ago

BLIVA mlpc-ucsd

27

264

bsd-3-clause

12

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

llm lora blip2 bliva llama chatbot multimodal instruction-tuning visual-language-learning

Created 2023-08-02

26 commits to main branch, last one 5 months ago

Open-LLaVA-NeXT xiaoachen98

10

246

unknown

6

An open-source implementation for training LLaVA-NeXT.

gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning

Created 2024-05-11

33 commits to master branch, last one 2 days ago

RLHF-V RLHF-V

6

220

unknown

2

[CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback

gpt-4 llama rlhf-v chatbot multimodal multi-modality visual-language-learning

Created 2023-11-29

73 commits to main branch, last one 17 days ago

KarmaVLM thomas-yanxin

3

83

apache-2.0

1

🧘🏻‍♂️KarmaVLM (相生)：A family of high efficiency and powerful visual language model.

vlm llava qwen2 llama2 multimodel vision-language-model visual-language-learning

Created 2024-01-23

45 commits to main branch, last one 5 months ago

llama-multimodal-vqa AdrianBZG

5

33

mit

1

Multimodal Instruction Tuning for Llama 3

vqa gpt-4 llama llama2 llama3 chatbot chatgpt multimodal huggingface language-models instruction-tuning visual-language-learning visual-question-answering multimodal-instruction-tuning

Created 2024-04-22

4 commits to main branch, last one 5 months ago