16 results found Sort:

BradyFU
Awesome-Multimodal-Large-Language-Models BradyFU
801
12.5k
unknown
273
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
multi-modality chain-of-thought instruction-tuning in-context-learning instruction-following large-language-models visual-instruction-tuning large-vision-language-model multimodal-chain-of-thought large-vision-language-models multimodal-instruction-tuning multimodal-in-context-learning multimodal-large-language-models
Created 2023-05-19
713 commits to main branch, last one 8 days ago
ShareGPT4Omni
ShareGPT4Video ShareGPT4Omni
44
1.3k
unknown
32
[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
gpt sora gpt-4v chatgpt text-to-video large-language-models large-multimodal-models large-video-language-models large-vision-language-models
Created 2024-06-06
44 commits to master branch, last one 28 days ago
NVlabs
DoRA NVlabs
40
615
other
9
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
lora deep-learning instruction-tuning vision-and-language deep-neural-networks commonsense-reasoning large-language-models parameter-efficient-tuning large-vision-language-models parameter-efficient-fine-tuning
Created 2024-04-11
45 commits to main branch, last one about a month ago
Paranioar
Awesome_Matching_Pretraining_Transfering Paranioar
47
398
mit
11
The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.
tutorial awesome-list image-text-matching large-vision-models vision-and-language image-text-retrieval video-text-retrieval cross-modal-retrieval large-language-models multimodal-pretraining video-text-recognition memory-efficient-tuning visual-semantic-embedding large-vision-language-models parameter-efficient-fine-tuning multimodal-large-language-models
Created 2020-12-22
129 commits to main branch, last one 3 months ago
BradyFU
Video-MME BradyFU
12
398
unknown
5
✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
mme video video-mme large-language-models large-vision-language-models multimodal-large-language-models
Created 2024-06-02
46 commits to main branch, last one 4 months ago
YingqingHe
Awesome-LLMs-meet-Multimodal-Generation YingqingHe
19
343
unknown
13
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
aigc text-to-3d multimodality text-to-audio text-to-image text-to-music text-to-sound text-to-video text-to-speech multimodal-models large-language-models multimodal-generation large-vision-language-models multimodal-large-language-models
Created 2023-11-17
338 commits to main branch, last one a day ago
burglarhobbit
Awesome-Medical-Large-Language-Models burglarhobbit
28
242
cc0-1.0
9
Curated papers on Large Language Models in Healthcare and Medical domain
large-language-models large-vision-language-models multimodal-large-language-models
Created 2023-06-28
45 commits to main branch, last one 3 months ago
tianyi-lab
HallusionBench tianyi-lab
7
241
bsd-3-clause
4
[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
llm lmm vlms gpt-4 llava gpt-4v benchmark benchmarks hallucination large-language-models large-vision-language-models
Created 2023-10-22
135 commits to main branch, last one a day ago
khuangaf
Awesome-Chart-Understanding khuangaf
16
163
unknown
6
A curated list of recent and past chart understanding work based on our survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models.
awesome-list chart-captioning chart-summarization chart-understanding chart-question-answering large-vision-language-models
Created 2024-01-10
47 commits to main branch, last one 3 months ago
ShareGPT4Omni
ShareGPT4V ShareGPT4Omni
4
149
unknown
2
[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
gpt gpt4v gpt-4v chatgpt eccv2024 language-model instruction-tuning large-language-models vision-language-model large-multimodal-models large-vision-language-models
Created 2024-06-06
3 commits to master branch, last one 4 months ago
MMStar-Benchmark
MMStar MMStar-Benchmark
5
145
unknown
1
[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
llm llms lvlm lvlms evaluation multimodal multimodality multimodal-learning large-language-models large-multimodal-models visual-question-answering large-vision-language-model large-vision-language-models
Created 2024-03-29
19 commits to main branch, last one about a month ago
llmbev
talk2bev llmbev
9
96
bsd-3-clause
2
Talk2BEV: Language-Enhanced Bird's Eye View Maps (Accepted to ICRA'24)
gpt-4 birds-eye-view autonomous-driving occupancy-grid-map large-language-models large-vision-language-models
Created 2023-09-15
33 commits to main branch, last one 2 days ago
yfzhang114
LLaVA-Align yfzhang114
2
71
apache-2.0
2
This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strategy.
debiasing hallucination large-vision-language-models
Created 2024-01-23
7 commits to main branch, last one 7 months ago
yu-rp
apiprompting yu-rp
3
44
mit
2
[ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models
prompting visual-prompting vision-language-model vision-language-models large-multimodal-models large-vision-language-model large-vision-language-models
Created 2024-09-04
14 commits to master branch, last one 28 days ago
ys-zong
VLGuard ys-zong
0
44
unknown
3
[ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.
safety alignment large-language-models vision-language-model large-vision-language-models
Created 2024-02-03
13 commits to main branch, last one 2 months ago
FudanDISC
ReForm-Eval FudanDISC
4
33
apache-2.0
0
An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
llm gpt4 benchmark multimodal embodied-ai pre-training reformulation instruction-tuning in-context-learning instruction-following large-language-models visual-chain-of-thought multimodal-chain-of-thought large-vision-language-models
Created 2023-07-17
112 commits to main branch, last one 11 months ago