10 results found Sort:

Vision-CAIR
MiniGPT4-video Vision-CAIR
67
605
bsd-3-clause
12
Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
video-retrieval video-understanding long-video-understanding video-question-answering
Created 2024-03-23
190 commits to main branch, last one 3 months ago
rese1f
MovieChat rese1f
42
604
bsd-3-clause
12
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
llama dataset computer-vision large-language-models long-video-understanding multimodal-large-language-models
Created 2023-06-26
122 commits to main branch, last one 2 months ago
HKUDS
VideoRAG HKUDS
58
514
other
20
"VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videos"
rag llms multi-modal-llms large-language-models long-video-understanding retrieval-augmented-generation
Created 2025-02-03
44 commits to main branch, last one 3 days ago
JUNJIE99
MLVU JUNJIE99
0
188
unknown
4
🔥🔥MLVU: Multi-task Long Video Understanding Benchmark
mlvu videos benchmark multi-task long-video-understanding multimodal-large-language-models
Created 2024-06-02
158 commits to main branch, last one 6 days ago
Leon1207
Video-RAG-master Leon1207
16
163
unknown
7
This is the official implementation of our paper "Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension"
plug-and-play training-free video-understanding long-video-understanding video-large-language-models retrieval-augmented-generation multi-modal-large-language-model
Created 2024-11-19
38 commits to main branch, last one about a month ago
XLearning-SCU
2024-ICLR-Norton XLearning-SCU
8
113
apache-2.0
11
Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]
noisy-correspondence long-video-understanding video-language-pretraining
Created 2024-01-18
15 commits to main branch, last one 11 months ago
RenShuhuai-Andy
TESTA RenShuhuai-Andy
3
49
mit
3
[EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
video-qa video-understanding video-text-retrieval long-video-understanding
Created 2023-10-29
9 commits to main branch, last one about a year ago
kkahatapitiya
LangRepo kkahatapitiya
3
31
mit
1
Language Repository for Long Video Understanding
large-language-models long-video-understanding visual-question-answering
Created 2024-03-19
10 commits to main branch, last one 9 months ago
zjr2000
LLMVA-GEBC zjr2000
2
30
bsd-3-clause
1
Winner solution to Generic Event Boundary Captioning task in LOVEU Challenge (CVPR 2023 workshop)
video-captioning pytorch-implementation long-video-understanding
Created 2023-05-24
111 commits to main branch, last one about a year ago
OpenGVLab
TimeSuite OpenGVLab
1
28
mit
3
[ICLR 2025] TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning
temporal-grounding long-video-understanding
Created 2025-01-05
18 commits to main branch, last one 11 days ago