Search Results - RepositoryStats

2.2k

20.1k

apache-2.0

157

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning

Created 2023-04-17

460 commits to main branch, last one 5 months ago

InternVL OpenGVLab

461

5.9k

mit

52

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

gpt llm gpt-4o gpt-4v vit-6b vit-22b multi-modal image-classification image-text-retrieval video-classification semantic-segmentation vision-language-model

Created 2023-11-22

188 commits to main branch, last one 8 days ago

Qwen-VL QwenLM

378

5.0k

other

49

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

large-language-models vision-language-model

Created 2023-08-21

136 commits to master branch, last one 7 months ago

MGM dvlab-research

277

3.2k

apache-2.0

28

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

generation large-language-models vision-language-model

Created 2024-03-26

35 commits to main branch, last one 6 months ago

InternLM-XComposer InternLM

154

2.5k

apache-2.0

43

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

395 commits to main branch, last one 27 days ago

VLM_survey jingyi0000

216

2.5k

unknown

121

Collection of AWESOME vision-language models for vision tasks

clip survey deep-learning computer-vision multi-modal-model transfer-learning vision-language-model knowledge-distillation

Created 2023-03-30

86 commits to main branch, last one 3 days ago

DeepSeek-VL deepseek-ai

195

2.1k

mit

19

DeepSeek-VL: Towards Real-World Vision-Language Understanding

foundation-models vision-language-model vision-language-pretraining

Created 2024-03-07

11 commits to main branch, last one 6 months ago

Cradle BAAI-Agents

161

1.8k

mit

26

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, ...

ai gcc llm lmm vlm cradle ai-agent grounding personoid generative-ai multimodality computer-control foundation-agent ai-agents-framework large-language-models vision-language-model general-computer-control

Created 2024-03-03

34 commits to main branch, last one 21 hours ago

AdvancedLiterateMachinery AlibabaResearch

173

1.5k

apache-2.0

36

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

Created 2022-09-28

62 commits to main branch, last one about a month ago

prismer NVlabs

75

1.3k

other

16

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

vqa language-model image-captioning multi-task-learning vision-and-language multi-modal-learning vision-language-model

Created 2023-03-02

36 commits to main branch, last one 9 months ago

colpali illuin-tech

93

1.0k

mit

13

The code used to train and run inference with the ColPali architecture.

colpali information-retrieval vision-language-model retrieval-augmented-generation

Created 2024-06-20

113 commits to main branch, last one 14 hours ago

awesome-japanese-llm llm-jp

31

1.0k

apache-2.0

22

日本語LLMまとめ - Overview of Japanese LLMs

llm llms japanese multimodal japanese-llm llm-japanese generative-ai language-model language-models vision-language generative-model foundation-models generative-models japanese-language vision-and-language large-language-model large-language-models vision-language-model japanese-language-model

Created 2023-07-09

469 commits to main branch, last one 5 days ago

Chat-UniVi PKU-YuanGroup

43

830

apache-2.0

7

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

image-understanding video-understanding large-language-models vision-language-model

Created 2023-11-13

83 commits to main branch, last one 21 days ago

groundingLMM mbzuai-oryx

37

777

unknown

30

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

lmm llm-agent foundation-models vision-and-language vision-language-model

Created 2023-11-02

42 commits to main branch, last one 5 months ago

AlphaCLIP SunzeY

42

687

apache-2.0

13

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

deep-learning vision-language machine-learning vision-transformer vision-and-language vision-language-model

Created 2023-11-27

97 commits to main branch, last one 3 months ago

VoxPoser huangwl18

77

569

mit

9

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

robotics embodied-ai motion-planning foundation-models robotic-manipulation large-language-models vision-language-model

Created 2023-11-02

3 commits to main branch, last one about a year ago

Groma FoundationVision

59

556

apache-2.0

35

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 5 months ago

Awesome-Robotics-3D zubair-irshad

25

543

unknown

12

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

3d llm vlm nerf grasping robotics benchmarks navigation pointclouds pretraining scene-graph simulations manipulation computer-vision policy-learning diffusion-models foundation-models gaussian-splatting vision-language-model

Created 2024-08-12

41 commits to main branch, last one 2 days ago

InstructCV AlaaLab

47

520

other

32

[ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"

text-to-image diffusion-models generative-model stable-diffusion multi-task-learning vision-language-model

Created 2023-02-04

128 commits to main branch, last one 6 months ago

Ovis AIDC-AI

29

503

apache-2.0

6

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

qwen llama3 chatbot multimodal multimodality vision-language-model vision-language-learning multimodal-large-language-models

Created 2024-06-13

31 commits to main branch, last one 2 days ago

mlx-vlm Blaizzy

35

467

mit

6

MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.

llm mlx llava idefics local-ai paligemma apple-silicon vision-framework vision-transformer vision-language-model

Created 2024-04-16

161 commits to main branch, last one 15 days ago

Multi-Modality-Arena OpenGVLab

35

463

unknown

6

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP...

vqa chat llms gradio chatbot chatgpt multi-modality large-language-models vision-language-model

Created 2023-05-10

86 commits to main branch, last one 6 months ago

awesome-vlm-architectures gokayfem

22

398

cc0-1.0

12

Famous Vision Language Models and Their Architectures

vlm blip clip llava cogvlm kosmos awesome qwen-vl internlm multimodal awesome-list text-encoder image-encoder vision-language-model

Created 2024-02-15

231 commits to main branch, last one about a month ago

awesome-knowledge-driven-AD PJLab-ADG

23

396

apache-2.0

21

A curated list of awesome knowledge-driven autonomous driving (continually updated)

knowledge-driven autonomous-driving large-language-models vision-language-model

Created 2023-10-24

51 commits to main branch, last one 5 months ago

Open-LLaVA-NeXT xiaoachen98

19

383

unknown

12

An open-source implementation for training LLaVA-NeXT.

gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning

Created 2024-05-11

36 commits to master branch, last one 14 days ago