27 results found Sort:

OpenGVLab
InternVideo OpenGVLab
108
1.8k
apache-2.0
27
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
benchmark multimodal video-clip video-data video-dataset self-supervised video-retrieval foundation-models action-recognition instruction-tuning masked-autoencoder vision-transformer video-understanding zero-shot-retrieval contrastive-learning open-set-recognition video-question-answering zero-shot-classification temporal-action-localization spatio-temporal-action-localization
Created 2022-11-23
247 commits to main branch, last one 17 hours ago
MCG-NJU
VideoMAE MCG-NJU
141
1.5k
other
15
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
mae pytorch transformer neurips-2022 video-analysis video-transformer action-recognition masked-autoencoder vision-transformer video-understanding self-supervised-learning video-representation-learning
Created 2022-03-23
64 commits to main branch, last one about a year ago
keyu-tian
SparK keyu-tian
81
1.3k
mit
20
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling...
cnn mae ssl bert iclr convnet pytorch iclr2023 pretrain mask-rcnn pretraining deep-learning object-detection pre-trained-model masked-autoencoder sparse-convolution instance-segmentation masked-image-modeling self-supervised-learning convolutional-neural-networks
Created 2023-01-05
90 commits to main branch, last one about a year ago
EdisonLeeeee
Awesome-Masked-Autoencoders EdisonLeeeee
52
816
mit
30
A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).
mae masked-autoencoder self-supervised-learning
Created 2022-05-23
161 commits to master branch, last one 9 months ago
Lupin1998
Awesome-MIM Lupin1998
17
324
apache-2.0
7
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
gpt mae bert awesome-mim awesome-list pre-training deep-learning computer-vision masked-modeling generative-models masked-autoencoder vision-transformer masked-image-modeling representation-learning self-supervised-learning
Created 2022-07-30
76 commits to master branch, last one 6 months ago
implus
UM-MAE implus
20
242
other
4
Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
mae coco ade20k swin-transformer masked-autoencoder masked-image-modeling imagenet-classification self-supervised-learning pyramid-vision-transformer hierarchical-vision-transformer
Created 2022-05-19
25 commits to main branch, last one 2 years ago
uncbiag
SimpleClick uncbiag
38
228
mit
5
SimpleClick: Interactive Image Segmentation with Simple Vision Transformers (ICCV 2023)
pytorch masked-autoencoder vision-transformers interactive-segmentation
Created 2022-09-26
88 commits to v1.0 branch, last one 18 days ago
implus
mae_segmentation implus
14
161
unknown
3
reproduction of semantic segmentation using masked autoencoder (mae)
mae vit masked-autoencoder vision-transformer semantic-segmentation self-supervised-learning
Created 2022-02-03
3 commits to main branch, last one 3 years ago
xyzforever
BEVT xyzforever
19
159
apache-2.0
7
PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
bert pytorch deep-learning foundation-models action-recognition masked-autoencoder video-understanding self-supervised-learning video-representation-learning
Created 2022-03-02
9 commits to main branch, last one 2 years ago
ruiwang2021
mvd ruiwang2021
11
124
other
5
[CVPR2023] Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning (https://arxiv.org/abs/2212.04500)
cvpr2023 action-recognition masked-autoencoder vision-transformer video-understanding self-supervised-learning video-representation-learning
Created 2022-12-08
12 commits to main branch, last one about a year ago
TonyLianLong
CrossMAE TonyLianLong
6
107
other
3
Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
mae deep-learning computer-vision masked-autoencoder self-supervised-learning
Created 2024-01-23
12 commits to main branch, last one 4 months ago
zubair-irshad
NeRF-MAE zubair-irshad
5
98
mit
7
[ECCV 2024] Pytorch code for our ECCV'24 paper NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields
3d vit nerf 3d-unet multi-view instant-ngp 3d-detection transformers super-resoluion 3d-deep-learning neural-rendering masked-autoencoder vision-transformers semantic-segmantation neural-radiance-fields feature-pyramid-network region-proposal-network representation-learning differentiable-rendering self-supervised-learning
Created 2024-03-27
16 commits to main branch, last one 20 days ago
habla-liaa
encodecmae habla-liaa
4
95
unknown
4
Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'
audio encodec deep-learning masked-autoencoder representation-learning
Created 2023-09-07
41 commits to main branch, last one 8 months ago
nttcslab
m2d nttcslab
4
92
other
4
Masked Modeling Duo: Towards a Universal Audio Pre-training Framework
audio masked-autoencoder masked-modeling-duo self-supervised-learning
Created 2023-01-15
29 commits to master branch, last one 8 months ago
Haochen-Wang409
HPM Haochen-Wang409
7
91
apache-2.0
2
[CVPR'23] Hard Patches Mining for Masked Image Modeling
coco ade20k cvpr2023 imagenet computer-vision masked-autoencoder pattern-recognition masked-image-modeling unsupervised-learning self-supervised-learning
Created 2023-03-08
4 commits to master branch, last one about a year ago
nttcslab
msm-mae nttcslab
8
90
other
7
Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations
audio deep-learning masked-autoencoder
Created 2022-03-12
18 commits to main branch, last one 9 months ago
rishikksh20
AudioMAE-pytorch rishikksh20
6
66
mit
2
Unofficial PyTorch implementation of Masked Autoencoders that Listen
tts speech autoencoder speech-synthesis masked-autoencoder self-supervised-learning
Created 2022-08-05
12 commits to master branch, last one 2 years ago
HKUDS
MAERec HKUDS
5
62
unknown
4
[SIGIR'2023] "MAERec: Graph Masked Autoencoder for Sequential Recommendation"
masked-autoencoder recommender-systems graph-neural-networks self-supervised-learning sequential-recommendation
Created 2023-05-08
12 commits to main branch, last one about a year ago
MCG-NJU
VideoMAE-Action-Detection MCG-NJU
6
60
other
2
[NeurIPS 2022 Spotlight] VideoMAE for Action Detection
mae pytorch videomae transformer neurips-2022 action-detection video-transformer masked-autoencoder video-understanding
Created 2022-09-30
6 commits to main branch, last one 2 years ago
recursionpharma
maes_microscopy recursionpharma
12
59
other
6
Official repo for Recursion's accepted spotlight paper at NeurIPS 2023 Generative AI & Biology workshop.
biology phenomics microscopy deep-learning generative-ai computer-vision masked-autoencoder
Created 2023-11-20
32 commits to trunk branch, last one 4 months ago
lucidrains
LVMAE-pytorch lucidrains
2
49
mit
1
Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch
deep-learning masked-autoencoder video-understanding artificial-intelligence
Created 2024-11-23
4 commits to main branch, last one 4 months ago
naver-ai
augsub naver-ai
1
36
other
2
[CVPR 2025] Official PyTorch implementation of MaskSub "Masking meets Supervision: A Strong Learning Alliance"
cvpr2025 backbone-models self-distillation masked-autoencoder imagenet-classification
Created 2023-06-12
9 commits to main branch, last one 15 days ago
lyhkevin
MT-Net lyhkevin
2
36
unknown
1
Multi-scale Transformer Network for Cross-Modality MR Image Synthesis (IEEE TMI)
mri pytorch synthesis multi-modal deep-learning masked-autoencoder
Created 2022-07-22
36 commits to main branch, last one about a year ago
shlokk
mae-contrastive shlokk
3
31
unknown
4
Official implementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".
pytorch masked-autoencoder contrastive-learning self-supervised-learning
Created 2022-11-18
25 commits to main branch, last one 2 years ago
stoneMo
DeepAVFusion stoneMo
2
31
apache-2.0
5
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
masked-autoencoder attention-mechanism multimodal-learning audio-visual-learning masked-image-modeling sound-source-separation self-supervised-learning transformer-architecture sound-source-localization audio-visual-correspondence
Created 2023-12-02
6 commits to main branch, last one 8 months ago
Event-AHU
VFM-Det Event-AHU
3
31
unknown
1
VFM-Det: Towards High-Performance Vehicle Detection via Large Foundation Models
big-model vehiclemae vehicle-detection attribute-learning masked-autoencoder pre-trained-big-model
Created 2024-05-03
38 commits to main branch, last one 24 hours ago
Westlake-AI
A2MIM Westlake-AI
4
26
apache-2.0
1
[ICML 2023] Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN
mae a2mim pytorch imagenet autoregressive object-detection transfer-learning masked-autoencoder vision-transformer masked-image-modeling semantic-segmentation self-supervised-learning convolutional-neural-networks
Created 2023-04-25
9 commits to main branch, last one 7 months ago