8 results found Sort:

Vision-CAIR
MiniGPT4-video Vision-CAIR
65
585
bsd-3-clause
12
Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
video-retrieval video-understanding long-video-understanding video-question-answering
Created 2024-03-23
190 commits to main branch, last one about a month ago
rese1f
MovieChat rese1f
42
575
bsd-3-clause
12
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
llama dataset computer-vision large-language-models long-video-understanding multimodal-large-language-models
Created 2023-06-26
122 commits to main branch, last one 2 days ago
JUNJIE99
MLVU JUNJIE99
0
173
unknown
4
🔥🔥MLVU: Multi-task Long Video Understanding Benchmark
mlvu videos benchmark multi-task long-video-understanding multimodal-large-language-models
Created 2024-06-02
141 commits to main branch, last one 4 days ago
XLearning-SCU
2024-ICLR-Norton XLearning-SCU
8
111
apache-2.0
10
Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]
noisy-correspondence long-video-understanding video-language-pretraining
Created 2024-01-18
15 commits to main branch, last one 9 months ago
Leon1207
Video-RAG-master Leon1207
8
102
unknown
6
This is the official implementation of our paper "Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension"
plug-and-play training-free video-understanding long-video-understanding video-large-language-models retrieval-augmented-generation multi-modal-large-language-model
Created 2024-11-19
34 commits to main branch, last one 5 days ago
RenShuhuai-Andy
TESTA RenShuhuai-Andy
3
49
mit
3
[EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
video-qa video-understanding video-text-retrieval long-video-understanding
Created 2023-10-29
9 commits to main branch, last one about a year ago
kkahatapitiya
LangRepo kkahatapitiya
3
31
mit
2
Language Repository for Long Video Understanding
large-language-models long-video-understanding visual-question-answering
Created 2024-03-19
10 commits to main branch, last one 7 months ago
zjr2000
LLMVA-GEBC zjr2000
2
29
bsd-3-clause
1
Winner solution to Generic Event Boundary Captioning task in LOVEU Challenge (CVPR 2023 workshop)
video-captioning pytorch-implementation long-video-understanding
Created 2023-05-24
111 commits to main branch, last one about a year ago