6 results found Sort:

v-iashin
BMT v-iashin
57
224
mit
6
Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)
bmt i3d bmvc audio video bmvc20 pytorch transformer video-features bi-modal-encoder multimodal-fusion proposal-generator activitynet-captions bi-modal-transformer dense-video-captioning temporal-action-proposals
Created 2020-05-06
36 commits to master branch, last one about a year ago
declare-lab
Multimodal-Infomax declare-lab
33
161
mit
4
This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNL...
multimodal-fusion multimodal-deep-learning multimodal-sentiment-analysis
Created 2021-08-28
12 commits to main branch, last one about a year ago
mahmoodlab
MCAT mahmoodlab
34
156
gpl-3.0
4
Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images - ICCV 2021
mcat genomics pathology mahmoodlab multimodal early-fusion multimodal-fusion multimodal-deep-learning
Created 2021-04-16
29 commits to master branch, last one 2 years ago
thuiar
MIntRec thuiar
12
74
mit
2
MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)
acm-mm acm-mm-22 multimodal-fusion speaker-recognition artificial-intelligence multimodal-deep-learning multimodal-intent-analysis
Created 2022-09-09
25 commits to main branch, last one 9 months ago
akashe
Multimodal-action-recognition akashe
13
70
unknown
1
Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
multimodality cross-attention multimodal-data multimodal-fusion multimodal-learning multimodal-deep-learning multimodal-action-recognition
Created 2021-05-19
14 commits to main branch, last one 3 years ago
ai-forever
fusion_brain_aij2021 ai-forever
16
50
unknown
5
Creating multimodal multitask models
bilingual multitask java-to-python multimodal-fusion visual-question-answering zero-shot-object-detection handwritten-text-recognition
Created 2021-09-13
271 commits to main branch, last one 2 years ago