Search Results - RepositoryStats

2.3k

20.8k

apache-2.0

157

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

gpt-4 llama llava llama2 chatbot chatgpt llama-2 multimodal multi-modality foundation-models instruction-tuning vision-language-model visual-language-learning

Created 2023-04-17

460 commits to main branch, last one 7 months ago

InternVL OpenGVLab

496

6.5k

mit

57

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

gpt llm gpt-4o gpt-4v vit-6b vit-22b multi-modal image-classification image-text-retrieval video-classification semantic-segmentation vision-language-model

Created 2023-11-22

230 commits to main branch, last one 3 hours ago

Qwen-VL QwenLM

396

5.2k

other

49

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

large-language-models vision-language-model

Created 2023-08-21

136 commits to master branch, last one 8 months ago

MGM dvlab-research

281

3.2k

apache-2.0

28

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

generation large-language-models vision-language-model

Created 2024-03-26

35 commits to main branch, last one 7 months ago

InternLM-XComposer InternLM

159

2.7k

apache-2.0

43

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

gpt llm mllm gpt-4 chatgpt foundation multimodal language-model multi-modality instruction-tuning vision-transformer large-language-model supervised-finetuning vision-language-model visual-language-learning large-vision-language-model

Created 2023-09-26

409 commits to main branch, last one 3 days ago

VLM_survey jingyi0000

227

2.6k

unknown

125

Collection of AWESOME vision-language models for vision tasks

clip survey deep-learning computer-vision multi-modal-model transfer-learning vision-language-model knowledge-distillation

Created 2023-03-30

89 commits to main branch, last one 18 days ago

DeepSeek-VL deepseek-ai

202

2.2k

mit

20

DeepSeek-VL: Towards Real-World Vision-Language Understanding

foundation-models vision-language-model vision-language-pretraining

Created 2024-03-07

11 commits to main branch, last one 8 months ago

Cradle BAAI-Agents

168

1.9k

mit

26

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, ...

ai gcc llm lmm vlm cradle ai-agent grounding personoid generative-ai multimodality computer-control foundation-agent ai-agents-framework large-language-models vision-language-model general-computer-control

Created 2024-03-03

35 commits to main branch, last one about a month ago

AdvancedLiterateMachinery AlibabaResearch

180

1.6k

apache-2.0

37

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

Created 2022-09-28

64 commits to main branch, last one 5 days ago

prismer NVlabs

74

1.3k

other

16

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

vqa language-model image-captioning multi-task-learning vision-and-language multi-modal-learning vision-language-model

Created 2023-03-02

36 commits to main branch, last one 11 months ago

colpali illuin-tech

111

1.3k

mit

15

The code used to train and run inference with the ColPali architecture.

colpali information-retrieval vision-language-model retrieval-augmented-generation

Created 2024-06-20

125 commits to main branch, last one 8 days ago

awesome-japanese-llm llm-jp

31

1.0k

apache-2.0

25

日本語LLMまとめ - Overview of Japanese LLMs

llm llms japanese multimodal japanese-llm llm-japanese generative-ai language-model language-models vision-language generative-model foundation-models generative-models japanese-language vision-and-language large-language-model large-language-models vision-language-model japanese-language-model

Created 2023-07-09

486 commits to main branch, last one 5 days ago

Chat-UniVi PKU-YuanGroup

43

897

apache-2.0

7

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

image-understanding video-understanding large-language-models vision-language-model

Created 2023-11-13

83 commits to main branch, last one 2 months ago

groundingLMM mbzuai-oryx

38

796

unknown

31

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

lmm llm-agent foundation-models vision-and-language vision-language-model

Created 2023-11-02

43 commits to main branch, last one 28 days ago

AlphaCLIP SunzeY

46

738

apache-2.0

13

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

deep-learning vision-language machine-learning vision-transformer vision-and-language vision-language-model

Created 2023-11-27

97 commits to main branch, last one 4 months ago

VoxPoser huangwl18

80

605

mit

9

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

robotics embodied-ai motion-planning foundation-models robotic-manipulation large-language-models vision-language-model

Created 2023-11-02

3 commits to main branch, last one about a year ago

mlx-vlm Blaizzy

53

598

mit

8

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

llm mlx llava molmo idefics pixtral local-ai florence2 paligemma apple-silicon vision-framework vision-transformer vision-language-model

Created 2024-04-16

180 commits to main branch, last one 15 days ago

Awesome-Robotics-3D zubair-irshad

32

595

unknown

14

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

3d llm vlm nerf grasping robotics benchmarks navigation pointclouds pretraining scene-graph simulations manipulation computer-vision policy-learning diffusion-models foundation-models gaussian-splatting vision-language-model

Created 2024-08-12

41 commits to main branch, last one about a month ago

Groma FoundationVision

61

585

apache-2.0

36

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

llm mllm llama llama2 grounding multimodal foundation-models large-language-models vision-language-model

Created 2024-04-21

30 commits to main branch, last one 6 months ago

Ovis AIDC-AI

33

584

apache-2.0

7

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

qwen llama3 chatbot multimodal multimodality vision-language-model vision-language-learning multimodal-large-language-models

Created 2024-06-13

32 commits to main branch, last one 25 days ago

InstructCV AlaaLab

50

535

other

32

[ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"

text-to-image diffusion-models generative-model stable-diffusion multi-task-learning vision-language-model

Created 2023-02-04

128 commits to main branch, last one 7 months ago

awesome-vlm-architectures gokayfem

25

514

cc0-1.0

12

Famous Vision Language Models and Their Architectures

vlm blip clip llava cogvlm kosmos awesome qwen-vl internlm multimodal awesome-list text-encoder image-encoder vision-language-model

Created 2024-02-15

231 commits to main branch, last one 3 months ago

VisRAG OpenBMB

36

505

apache-2.0

9

Parsing-free RAG supported by VLMs

rag retrieval multi-modal multi-modality document-retrieval vision-language-model document-understanding retrieval-augmented-generation

Created 2024-10-14

73 commits to master branch, last one 10 days ago

Multi-Modality-Arena OpenGVLab

36

479

unknown

6

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP...

vqa chat llms gradio chatbot chatgpt multi-modality large-language-models vision-language-model

Created 2023-05-10

86 commits to main branch, last one 8 months ago

minimind-v jingyaogong

46

443

apache-2.0

14

「大模型」3小时从0训练27M参数的视觉多模态VLM，个人显卡即可推理训练！

chatgpt vision-language-model artificial-intelligence

Created 2024-09-11

96 commits to master branch, last one 8 days ago

meme-search neonwatty

17

422

apache-2.0

3

The open source Meme Search Engine. Free and built to self-host locally with Python, Ruby, and Docker.

ruby docker python demo-app self-hosted generative-ai ruby-on-rails text-embedding vector-database machine-learning large-language-models vision-language-model

Created 2024-06-08

313 commits to main branch, last one 17 days ago

awesome-knowledge-driven-AD PJLab-ADG

23

414

apache-2.0

21

A curated list of awesome knowledge-driven autonomous driving (continually updated)

knowledge-driven autonomous-driving large-language-models vision-language-model

Created 2023-10-24

51 commits to main branch, last one 6 months ago

Open-LLaVA-NeXT xiaoachen98

20

401

unknown

13

An open-source implementation for training LLaVA-NeXT.

gpt-4 gpt4o llama llava llama3 chatbot chatgpt llava-next multimodal multi-modality vision-language-model large-multimodal-models visual-language-learning

Created 2024-05-11

36 commits to master branch, last one about a month ago

EmbedAnything StarlightSearch

28

352

apache-2.0

6

A minimalist yet highly performant, lightweight, lightning fast, multisource, multimodal and local Ingestion, Inference and Indexing solution, built in Rust.

rag jina onnx rust index openai splade colpali indexing ingestion rust-lang onnxruntime vector-database embedding-models late-interaction machine-learning information-retrieval large-language-models vision-language-model

Created 2024-03-31

525 commits to main branch, last one 4 hours ago

Awesome-Prompt-Adapter-Learning-for-VLMs zhengli97

15

347

apache-2.0

7

A curated list of awesome prompt/adapter learning methods for vision-language models like CLIP.

paper-list prompt-learning adapter-learning few-shot-learning zero-shot-learning vision-language-model few-shot-classifcation

Created 2024-03-15

44 commits to main branch, last one a day ago