Search Results - RepositoryStats

Awesome-Multimodal-Large-Language-Models BradyFU

691

10.3k

unknown

238

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

multi-modality chain-of-thought instruction-tuning in-context-learning instruction-following large-language-models visual-chain-of-thought visual-instruction-tuning visual-in-context-learning large-vision-language-model multimodal-chain-of-thought large-vision-language-models multimodal-instruction-tuning multimodal-in-context-learning multimodal-large-language-models

Created 2023-05-19

645 commits to main branch, last one a day ago

ShareGPT4Video ShareGPT4Omni

32

1.1k

unknown

28

An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

gpt sora gpt-4v chatgpt text-to-video large-language-models large-multimodal-models large-video-language-models large-vision-language-models

Created 2024-06-06

30 commits to master branch, last one a day ago

Awesome_Matching_Pretraining_Transfering Paranioar

48

365

mit

11

The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

tutorial awesome-list image-text-matching large-vision-models vision-and-language image-text-retrieval video-text-retrieval cross-modal-retrieval large-language-models multimodal-pretraining video-text-recognition memory-efficient-tuning visual-semantic-embedding large-vision-language-models parameter-efficient-fine-tuning

Created 2020-12-22

128 commits to main branch, last one 22 days ago

DoRA NVlabs

18

355

other

10

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

lora deep-learning instruction-tuning vision-and-language deep-neural-networks commonsense-reasoning large-language-models parameter-efficient-tuning large-vision-language-models parameter-efficient-fine-tuning

Created 2024-04-11

39 commits to main branch, last one 11 days ago

Video-MME BradyFU

8

278

unknown

5

✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

mme video video-mme large-language-models large-vision-language-models multimodal-large-language-models

Created 2024-06-02

46 commits to main branch, last one 11 days ago

HallusionBench tianyi-lab

3

200

bsd-3-clause

4

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

llm lmm vlms gpt-4 llava gpt-4v benchmark benchmarks hallucination large-language-models large-vision-language-models

Created 2023-10-22

132 commits to main branch, last one 3 months ago

Awesome-LLMs-meet-Multimodal-Generation YingqingHe

14

194

unknown

8

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

aigc text-to-3d multimodality text-to-audio text-to-image text-to-music text-to-sound text-to-video text-to-speech multimodal-models large-language-models multimodal-generation large-vision-language-models multimodal-large-language-models

Created 2023-11-17

325 commits to main branch, last one 23 hours ago

Awesome-Medical-Large-Language-Models burglarhobbit

12

151

cc0-1.0

7

Curated papers on Large Language Models in Healthcare and Medical domain

large-language-models large-vision-language-models multimodal-large-language-models

Created 2023-06-28

35 commits to main branch, last one 13 days ago

MMStar MMStar-Benchmark

1

124

unknown

1

This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

llm llms lvlm lvlms evaluation multimodal multimodality multimodal-learning large-language-models large-multimodal-models visual-question-answering large-vision-language-model large-vision-language-models

Created 2024-03-29

18 commits to main branch, last one 2 months ago

Awesome-Chart-Understanding khuangaf

8

100

unknown

4

A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.

awesome-list chart-captioning chart-summarization chart-understanding chart-question-answering large-vision-language-models

Created 2024-01-10

45 commits to main branch, last one a day ago

talk2bev llmbev

7

82

bsd-3-clause

2

Talk2BEV: Language-Enhanced Bird's Eye View Maps (Accepted to ICRA'24)

gpt-4 birds-eye-view autonomous-driving occupancy-grid-map large-language-models large-vision-language-models

Created 2023-09-15

32 commits to main branch, last one 5 months ago

LLaVA-Align yfzhang114

2

65

apache-2.0

2

This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strategy.

debiasing hallucination large-vision-language-models

Created 2024-01-23

7 commits to main branch, last one 3 months ago

ShareGPT4V ShareGPT4Omni

1

35

unknown

1

An official implementation of ShareGPT4V: Improving Large Multi-modal Models with Better Captions

gpt gpt4v gpt-4v chatgpt language-model instruction-tuning large-language-models vision-language-model large-multimodal-models large-vision-language-models

Created 2024-06-06

2 commits to master branch, last one 22 days ago

ReForm-Eval FudanDISC

4

32

apache-2.0

0

An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

llm gpt4 benchmark multimodal embodied-ai pre-training reformulation instruction-tuning in-context-learning instruction-following large-language-models visual-chain-of-thought multimodal-chain-of-thought large-vision-language-models

Created 2023-07-17

112 commits to main branch, last one 7 months ago