5 results found Sort:

microsoft
unilm microsoft
2.4k
19.1k
mit
297
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
llm nlp beit mllm trocr unilm xlm-e beit-3 bitnet kosmos minilm deepnet kosmos-1 layoutlm layoutxlm multimodal document-ai textdiffuser foundation-models pre-trained-model
Created 2019-07-23
1,180 commits to master branch, last one about a month ago
open-mmlab
mmpretrain open-mmlab
1.0k
3.3k
apache-2.0
31
OpenMMLab Pre-training Toolbox and Benchmark
mae beit clip moco resnet pytorch convnext mobilenet multimodal deep-learning swin-transformer pretrained-models vision-transformer image-classification constrastive-learning masked-image-modeling self-supervised-learning
Created 2020-07-09
973 commits to main branch, last one 5 months ago
open-mmlab
mmselfsup open-mmlab
426
3.1k
apache-2.0
44
OpenMMLab Self-Supervised Learning Toolbox and Benchmark
mae beit moco simclr pytorch simsiam masked-image-modeling unsupervised-learning self-supervised-learning
Created 2020-06-12
654 commits to main branch, last one about a year ago
PaddlePaddle
PASSL PaddlePaddle
63
265
apache-2.0
12
PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE 等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法
cvt mae pvt vit beit clip deit moco swav xcit paddle pixpro simclr moco-v2 convnext deep-learning swin-transformer vision-transformer self-supervised-learning
Created 2021-01-28
127 commits to main branch, last one 11 months ago
arxyzan
data2vec-pytorch arxyzan
26
164
mit
4
PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
beit fairseq pytorch roberta wav2vec data2vec huggingface self-supervised-learning
Created 2022-02-02
129 commits to main branch, last one about a year ago