23 results found Sort:

keyu-tian
SparK keyu-tian
86
1.5k
mit
27
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling...
cnn mae ssl bert iclr convnet pytorch iclr2023 pretrain mask-rcnn pretraining deep-learning object-detection pre-trained-model masked-autoencoder sparse-convolution instance-segmentation masked-image-modeling self-supervised-learning convolutional-neural-networks
Created 2023-01-05
90 commits to main branch, last one 11 months ago
OpenGVLab
InternVideo OpenGVLab
91
1.5k
apache-2.0
27
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
benchmark multimodal video-clip video-data video-dataset self-supervised video-retrieval foundation-models action-recognition instruction-tuning masked-autoencoder vision-transformer video-understanding zero-shot-retrieval contrastive-learning open-set-recognition video-question-answering zero-shot-classification temporal-action-localization spatio-temporal-action-localization
Created 2022-11-23
229 commits to main branch, last one 10 days ago
MCG-NJU
VideoMAE MCG-NJU
137
1.4k
other
16
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
mae pytorch transformer neurips-2022 video-analysis video-transformer action-recognition masked-autoencoder vision-transformer video-understanding self-supervised-learning video-representation-learning
Created 2022-03-23
64 commits to main branch, last one about a year ago
EdisonLeeeee
Awesome-Masked-Autoencoders EdisonLeeeee
52
791
mit
33
A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).
mae masked-autoencoder self-supervised-learning
Created 2022-05-23
161 commits to master branch, last one 5 months ago
Lupin1998
Awesome-MIM Lupin1998
16
311
apache-2.0
7
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
gpt mae bert awesome-mim awesome-list pre-training deep-learning computer-vision masked-modeling generative-models masked-autoencoder vision-transformer masked-image-modeling representation-learning self-supervised-learning
Created 2022-07-30
76 commits to master branch, last one 2 months ago
implus
UM-MAE implus
20
241
other
5
Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
mae coco ade20k swin-transformer masked-autoencoder masked-image-modeling imagenet-classification self-supervised-learning pyramid-vision-transformer hierarchical-vision-transformer
Created 2022-05-19
25 commits to main branch, last one 2 years ago
uncbiag
SimpleClick uncbiag
33
216
mit
7
SimpleClick: Interactive Image Segmentation with Simple Vision Transformers (ICCV 2023)
pytorch masked-autoencoder vision-transformers interactive-segmentation
Created 2022-09-26
86 commits to v1.0 branch, last one about a year ago
xyzforever
BEVT xyzforever
19
159
apache-2.0
8
PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
bert pytorch deep-learning foundation-models action-recognition masked-autoencoder video-understanding self-supervised-learning video-representation-learning
Created 2022-03-02
9 commits to main branch, last one 2 years ago
implus
mae_segmentation implus
14
158
unknown
3
reproduction of semantic segmentation using masked autoencoder (mae)
mae vit masked-autoencoder vision-transformer semantic-segmentation self-supervised-learning
Created 2022-02-03
3 commits to main branch, last one 2 years ago
ruiwang2021
mvd ruiwang2021
10
112
other
6
[CVPR2023] Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning (https://arxiv.org/abs/2212.04500)
cvpr2023 action-recognition masked-autoencoder vision-transformer video-understanding self-supervised-learning video-representation-learning
Created 2022-12-08
12 commits to main branch, last one about a year ago
TonyLianLong
CrossMAE TonyLianLong
5
97
other
4
Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
mae deep-learning computer-vision masked-autoencoder self-supervised-learning
Created 2024-01-23
12 commits to main branch, last one 16 days ago
habla-liaa
encodecmae habla-liaa
4
90
unknown
4
Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'
audio encodec deep-learning masked-autoencoder representation-learning
Created 2023-09-07
41 commits to main branch, last one 5 months ago
nttcslab
msm-mae nttcslab
8
89
other
7
Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations
audio deep-learning masked-autoencoder
Created 2022-03-12
18 commits to main branch, last one 6 months ago
Haochen-Wang409
HPM Haochen-Wang409
7
89
apache-2.0
3
[CVPR'23] Hard Patches Mining for Masked Image Modeling
coco ade20k cvpr2023 imagenet computer-vision masked-autoencoder pattern-recognition masked-image-modeling unsupervised-learning self-supervised-learning
Created 2023-03-08
4 commits to master branch, last one about a year ago
zubair-irshad
NeRF-MAE zubair-irshad
3
87
mit
8
[ECCV 2024] Pytorch code for our ECCV'24 paper NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields
3d vit nerf 3d-unet multi-view instant-ngp 3d-detection transformers super-resoluion 3d-deep-learning neural-rendering masked-autoencoder vision-transformers semantic-segmantation neural-radiance-fields feature-pyramid-network region-proposal-network representation-learning differentiable-rendering self-supervised-learning
Created 2024-03-27
11 commits to main branch, last one 4 months ago
nttcslab
m2d nttcslab
2
79
other
4
Masked Modeling Duo: Towards a Universal Audio Pre-training Framework
audio masked-autoencoder masked-modeling-duo self-supervised-learning
Created 2023-01-15
29 commits to master branch, last one 4 months ago
rishikksh20
AudioMAE-pytorch rishikksh20
6
65
mit
3
Unofficial PyTorch implementation of Masked Autoencoders that Listen
tts speech autoencoder speech-synthesis masked-autoencoder self-supervised-learning
Created 2022-08-05
12 commits to master branch, last one 2 years ago
HKUDS
MAERec HKUDS
5
60
unknown
5
[SIGIR'2023] "MAERec: Graph Masked Autoencoder for Sequential Recommendation"
masked-autoencoder recommender-systems graph-neural-networks self-supervised-learning sequential-recommendation
Created 2023-05-08
12 commits to main branch, last one about a year ago
MCG-NJU
VideoMAE-Action-Detection MCG-NJU
5
55
other
2
[NeurIPS 2022 Spotlight] VideoMAE for Action Detection
mae pytorch videomae transformer neurips-2022 action-detection video-transformer masked-autoencoder video-understanding
Created 2022-09-30
6 commits to main branch, last one about a year ago
recursionpharma
maes_microscopy recursionpharma
8
46
other
7
Official repo for Recursion's accepted spotlight paper at NeurIPS 2023 Generative AI & Biology workshop.
biology phenomics microscopy deep-learning generative-ai computer-vision masked-autoencoder
Created 2023-11-20
32 commits to trunk branch, last one about a month ago
lucidrains
LVMAE-pytorch lucidrains
1
45
mit
1
Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch
deep-learning masked-autoencoder video-understanding artificial-intelligence
Created 2024-11-23
4 commits to main branch, last one 26 days ago
lyhkevin
MT-Net lyhkevin
2
35
unknown
1
Multi-scale Transformer Network for Cross-Modality MR Image Synthesis (IEEE TMI)
mri pytorch synthesis multi-modal deep-learning masked-autoencoder
Created 2022-07-22
36 commits to main branch, last one 12 months ago
stoneMo
DeepAVFusion stoneMo
2
25
apache-2.0
6
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
masked-autoencoder attention-mechanism multimodal-learning audio-visual-learning masked-image-modeling sound-source-separation self-supervised-learning transformer-architecture sound-source-localization audio-visual-correspondence
Created 2023-12-02
6 commits to main branch, last one 4 months ago