Search Results - RepositoryStats

Awesome-Multimodal-Large-Language-Models BradyFU

838

13.2k

unknown

257

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

multi-modality chain-of-thought instruction-tuning in-context-learning instruction-following large-language-models visual-instruction-tuning large-vision-language-model multimodal-chain-of-thought large-vision-language-models multimodal-instruction-tuning multimodal-in-context-learning multimodal-large-language-models

Created 2023-05-19

782 commits to main branch, last one 2 days ago

ShareGPT4Video ShareGPT4Omni

44

1.3k

unknown

32

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

gpt sora gpt-4v chatgpt text-to-video large-language-models large-multimodal-models large-video-language-models large-vision-language-models

Created 2024-06-06

44 commits to master branch, last one 2 months ago

DoRA NVlabs

44

665

other

11

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

lora deep-learning instruction-tuning vision-and-language deep-neural-networks commonsense-reasoning large-language-models parameter-efficient-tuning large-vision-language-models parameter-efficient-fine-tuning

Created 2024-04-11

45 commits to main branch, last one 2 months ago

Video-MME BradyFU

18

424

unknown

5

✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

mme video video-mme large-language-models large-vision-language-models multimodal-large-language-models

Created 2024-06-02

50 commits to main branch, last one 9 days ago

Awesome_Matching_Pretraining_Transfering Paranioar

47

405

mit

11

The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insigh...

tutorial awesome-list image-text-matching large-vision-models vision-and-language image-text-retrieval large-language-model video-text-retrieval cross-modal-retrieval large-language-models multimodal-pretraining video-text-recognition memory-efficient-tuning text-to-image-synthesis text-to-image-generation text-to-video-generation visual-semantic-embedding large-vision-language-models parameter-efficient-fine-tuning multimodal-large-language-models

Created 2020-12-22

130 commits to main branch, last one 8 days ago

Awesome-LLMs-meet-Multimodal-Generation YingqingHe

22

389

unknown

14

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

llm aigc lvlm mllm text-to-3d multimodality text-to-audio text-to-image text-to-music text-to-sound text-to-video text-to-speech multimodal-models large-language-models multimodal-generation large-vision-language-models multimodal-large-language-models

Created 2023-11-17

346 commits to main branch, last one about a month ago

Awesome-Medical-Large-Language-Models burglarhobbit

31

267

cc0-1.0

9

Curated papers on Large Language Models in Healthcare and Medical domain

large-language-models large-vision-language-models multimodal-large-language-models

Created 2023-06-28

45 commits to main branch, last one 5 months ago

HallusionBench tianyi-lab

7

259

bsd-3-clause

4

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

llm lmm vlms gpt-4 llava gpt-4v benchmark benchmarks hallucination large-language-models large-vision-language-models

Created 2023-10-22

136 commits to main branch, last one about a month ago

ShareGPT4V ShareGPT4Omni

4

178

unknown

3

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

gpt gpt4v gpt-4v chatgpt eccv2024 language-model instruction-tuning large-language-models vision-language-model large-multimodal-models large-vision-language-models

Created 2024-06-06

3 commits to master branch, last one 5 months ago

Awesome-Chart-Understanding khuangaf

19

174

unknown

6

A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.

awesome-list chart-captioning chart-summarization chart-understanding chart-question-answering large-vision-language-models

Created 2024-01-10

47 commits to main branch, last one 4 months ago

MMStar MMStar-Benchmark

5

156

unknown

1

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

llm llms lvlm lvlms evaluation multimodal multimodality multimodal-learning large-language-models large-multimodal-models visual-question-answering large-vision-language-model large-vision-language-models

Created 2024-03-29

19 commits to main branch, last one 2 months ago

talk2bev llmbev

10

102

bsd-3-clause

2

Talk2BEV: Language-Enhanced Bird's Eye View Maps (ICRA'24)

gpt-4 birds-eye-view autonomous-driving occupancy-grid-map large-language-models large-vision-language-models

Created 2023-09-15

33 commits to main branch, last one about a month ago

LLaVA-Align yfzhang114

2

75

apache-2.0

2

This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strategy.

debiasing hallucination large-vision-language-models

Created 2024-01-23

7 commits to main branch, last one 9 months ago

apiprompting yu-rp

3

54

mit

2

[ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models

prompting visual-prompting vision-language-model vision-language-models large-multimodal-models large-vision-language-model large-vision-language-models

Created 2024-09-04

14 commits to master branch, last one 2 months ago

Awesome-LVLM-Hallucination NishilBalar

3

51

unknown

2

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

llm mlm lvlm mllm hallucination hallucination-survey large-language-models hallucination-research vision-language-models hallucination-benchmark hallucination-detection hallucination-evaluation hallucination-mitigation multimodal-language-model large-vision-language-models multimodal-large-language-models

Created 2024-03-15

48 commits to master branch, last one 13 days ago

VLGuard ys-zong

2

48

unknown

3

[ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.

safety alignment large-language-models vision-language-model large-vision-language-models

Created 2024-02-03

13 commits to main branch, last one 4 months ago

ReForm-Eval FudanDISC

4

41

apache-2.0

0

An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

llm gpt4 benchmark multimodal embodied-ai pre-training reformulation instruction-tuning in-context-learning instruction-following large-language-models visual-chain-of-thought multimodal-chain-of-thought large-vision-language-models

Created 2023-07-17

112 commits to main branch, last one about a year ago

moh sled-group

1

26

unknown

7

Official Repository of Multi-Object Hallucination in Vision-Language Models (NeurIPS 2024)

multimodal object-hallucination large-vision-language-models

Created 2024-06-25

36 commits to main branch, last one about a month ago