11 results found Sort:

ArrowLuo
CLIP4Clip ArrowLuo
117
814
mit
12
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
clip msvd lsmdc didemo msrvtt search ranking retrieval multimodal activitynet multimodality retrieval-model multimodal-learning video-clip-retrieval video-text-retrieval
Created 2021-04-13
29 commits to master branch, last one 2 years ago
Paranioar
Awesome_Matching_Pretraining_Transfering Paranioar
48
365
mit
11
The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.
tutorial awesome-list image-text-matching large-vision-models vision-and-language image-text-retrieval video-text-retrieval cross-modal-retrieval large-language-models multimodal-pretraining video-text-recognition memory-efficient-tuning visual-semantic-embedding large-vision-language-models parameter-efficient-fine-tuning
Created 2020-12-22
128 commits to main branch, last one 22 days ago
microsoft
UniVL microsoft
54
332
mit
10
An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
coin joint video msrvtt caption pretrain alignment youcookii video-text pretraining caption-task localization segmentation multimodality retrieval-task video-language video-text-retrieval multimodal-sentiment-analysis
Created 2020-10-30
20 commits to main branch, last one about a year ago
whwu95
Cap4Video whwu95
16
218
mit
9
【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
video-understanding cross-modal-learning video-text-retrieval video-language-understanding
Created 2023-01-07
27 commits to main branch, last one about a month ago
salesforce
ALPRO salesforce
18
184
bsd-3-clause
7
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
video-language prompt-learning vision-and-language video-text-retrieval representation-learning video-question-answering
Created 2021-12-11
14 commits to main branch, last one about a year ago
m-bain
CondensedMovies m-bain
27
154
unknown
10
Story-Based Retrieval with Contextual Embeddings. Largest freely available movie video dataset. [ACCV'20]
dataset retrieval source-videos precomputed-features video-text-retrieval
Created 2020-04-21
34 commits to master branch, last one about a year ago
xuguohai
X-CLIP xuguohai
15
119
mit
2
An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
msvd lsmdc didemo msrvtt multimodal activitynet video-text-retrieval
Created 2022-09-19
4 commits to main branch, last one about a year ago
amazon-science
crossmodal-contrastive-learning amazon-science
11
55
apache-2.0
4
CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
video transformers multi-modality computer-vision video-captioning contrastive-learning video-text-retrieval natural-language-processing
Created 2021-10-12
4 commits to main branch, last one 2 years ago
alipay
Ant-Multi-Modal-Framework alipay
2
52
cc-by-4.0
2
Research Code for Multimodal-Cognition Team in Ant Group
video-editing multimodal-llm multimodal-learning image-text-retrieval video-text-retrieval
Created 2023-08-21
134 commits to main branch, last one 16 days ago
LeapLabTHU
Cross-Modal-Adapter LeapLabTHU
2
51
apache-2.0
5
[arXiv] Cross-Modal Adapter for Text-Video Retrieval
clip adapter pytorch deep-learning machine-learning vision-and-language video-text-retrieval parameter-efficient-tuning parameter-efficient-learning
Created 2022-11-16
15 commits to main branch, last one about a year ago
RenShuhuai-Andy
TESTA RenShuhuai-Andy
3
42
mit
2
[EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
video-qa video-understanding video-text-retrieval long-video-understanding
Created 2023-10-29
9 commits to main branch, last one 5 months ago