5 results found Sort:

microsoft
unilm microsoft
2.6k
20.4k
mit
307
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
llm nlp beit mllm trocr unilm xlm-e beit-3 bitnet kosmos minilm deepnet kosmos-1 layoutlm layoutxlm multimodal document-ai textdiffuser foundation-models pre-trained-model
Created 2019-07-23
1,229 commits to master branch, last one 6 days ago
open-mmlab
mmpretrain open-mmlab
1.1k
3.5k
apache-2.0
30
OpenMMLab Pre-training Toolbox and Benchmark
mae beit clip moco resnet pytorch convnext mobilenet multimodal deep-learning swin-transformer pretrained-models vision-transformer image-classification constrastive-learning masked-image-modeling self-supervised-learning
Created 2020-07-09
974 commits to main branch, last one about a month ago
open-mmlab
mmselfsup open-mmlab
432
3.2k
apache-2.0
45
OpenMMLab Self-Supervised Learning Toolbox and Benchmark
mae beit moco simclr pytorch simsiam masked-image-modeling unsupervised-learning self-supervised-learning
Created 2020-06-12
654 commits to main branch, last one about a year ago
PaddlePaddle
PASSL PaddlePaddle
65
277
apache-2.0
11
PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE 等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法
cvt mae pvt vit beit clip deit moco swav xcit paddle pixpro simclr moco-v2 convnext deep-learning swin-transformer vision-transformer self-supervised-learning
Created 2021-01-28
127 commits to main branch, last one about a year ago
arxyzan
data2vec-pytorch arxyzan
26
175
mit
5
PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
beit fairseq pytorch roberta wav2vec data2vec huggingface self-supervised-learning
Created 2022-02-02
129 commits to main branch, last one about a year ago