69 results found Sort:

datawhalechina
leedl-tutorial datawhalechina
2.6k
10.0k
other
257
《李宏毅深度学习教程》（李宏毅老师推荐👍），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
cnn gan rnn bert chatgpt pruning tutorial diffusion transformer deep-learning leedl-tutorial self-attention machine-learning transfer-learning network-compression reinforcement-learning
Created 2019-07-02
520 commits to master branch, last one 5 days ago
zhouhaoyi
Informer2020 zhouhaoyi
1.1k
5.0k
apache-2.0
36
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
pytorch forecasting time-series transformer deep-learning self-attention
Created 2020-12-07
158 commits to main branch, last one about a year ago
cmhungsteve
Awesome-Transformer-Attention cmhungsteve
475
4.3k
unknown
122
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
vit detr papers transformer awesome-list transformers deep-learning self-attention transformer-cv computer-vision transformer-models vision-transformer visual-transformer attention-mechanism transformer-awesome transformer-with-cv attention-mechanisms transformer-architecture
Created 2021-09-15
1,594 commits to main branch, last one 10 days ago
PetarV-
GAT PetarV-
639
3.1k
mit
45
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
python tensorflow self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-02-01
21 commits to master branch, last one 3 years ago
Diego999
pyGAT Diego999
686
2.8k
mit
17
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
python pytorch self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-03-02
36 commits to master branch, last one 2 years ago
gordicaleksa
pytorch-GAT gordicaleksa
314
2.3k
mit
46
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...
gat python jupyter pytorch attention pytorch-gat gat-tutorial deep-learning self-attention attention-mechanism pytorch-implementation graph-attention-network graph-attention-networks
Created 2020-12-26
110 commits to main branch, last one 3 years ago
github
CodeSearchNet github
380
2.1k
mit
61
Datasets, tools, and benchmarks for representation learning of code.
ml cnn nlp rnn bert data python datasets open-data tensorflow data-science deep-learning self-attention neural-networks machine-learning nlp-machine-learning representation-learning natural-language-processing programming-language-theory machine-learning-on-source-code
This repository has been archived (exclude archived)
Created 2019-02-28
286 commits to master branch, last one 2 years ago
microsoft
DeBERTa microsoft
213
1.9k
mit
42
The implementation of DeBERTa
bert roberta deeplearning language-model self-attention transformer-encoder representation-learning natural-language-understanding
Created 2020-06-08
55 commits to master branch, last one about a year ago
speedinghzl
CCNet speedinghzl
278
1.4k
mit
29
CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).
pytorch cityscape segmentation scene-parsing self-attention semantic-segmentation
Created 2018-11-26
71 commits to master branch, last one 3 years ago
DirtyHarryLYL
Transformer-in-Vision DirtyHarryLYL
142
1.3k
unknown
87
Recent Transformer-based CV and related works.
paper multi-modal transformer deep-learning self-attention computer-vision visual-language vision-transformers
Created 2021-02-11
828 commits to main branch, last one 9 months ago
The-AI-Summer
self-attention-cv The-AI-Summer
151
1.1k
mit
20
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
attention transformer transformers deep-learning self-attention machine-learning attention-mechanism artificial-intelligence machine-learning-algorithms
Created 2021-01-31
72 commits to main branch, last one 2 years ago
Separius
awesome-fast-attention Separius
108
980
gpl-3.0
32
list of efficient attention modules
awesome reformer attention linformer longformer transformer self-attention multihead-attention transformer-network attention-is-all-you-need
This repository has been archived (exclude archived)
Created 2020-07-31
46 commits to master branch, last one 2 years ago
brightmart
bert_language_understanding brightmart
211
959
unknown
49
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need
Created 2018-10-23
101 commits to master branch, last one 5 years ago
prakashpandey9
Text-Classification-Pytorch prakashpandey9
237
801
mit
21
Text classification using deep learning models in Pytorch
glove pytorch rnn-model lstm-model self-attention attention-model text-classification sentiment-classification
Created 2018-06-21
22 commits to master branch, last one 5 years ago
xxxnell
how-do-vits-work xxxnell
77
792
apache-2.0
7
(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
pytorch transformer loss-landscape self-attention vision-transformer
Created 2021-03-09
129 commits to transformer branch, last one about a year ago
kaituoxu
Speech-Transformer kaituoxu
194
766
unknown
30
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
asr pytorch attention end-to-end transformer self-attention attention-is-all-you-need
Created 2018-11-22
23 commits to master branch, last one about a year ago
NVlabs
FasterViT NVlabs
54
705
other
17
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
coco ade20k backbone image-net deep-learning self-attention object-detection foundation-models pre-trained-model vision-transformer visual-recognition image-classification semantic-segmentation
Created 2023-05-19
274 commits to main branch, last one about a month ago
daiquocnguyen
Graph-Transformer daiquocnguyen
77
626
apache-2.0
9
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
transformer self-attention node-embeddings graph-embeddings graph-transformer transformer-models graph-deep-learning text-classification graph-classification graph-neural-networks graph-machine-learning graph-representation-learning
Created 2019-08-03
181 commits to master branch, last one about a year ago
NVlabs
FAN NVlabs
28
462
other
21
Official PyTorch implementation of Fully Attentional Networks
coco backbone imagenet pre-train cityscapes corruption deep-learning self-attention visual-grouping object-detection visual-recognition out-of-distribution vision-transformers image-classification semantic-segmentation information-bottleneck
Created 2022-04-20
18 commits to master branch, last one about a year ago
Tixierae
deep_learning_NLP Tixierae
106
436
unknown
29
Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP
nlp nmt keras numpy doc2vec python3 pytorch skipgram word2vec attention cnn-keras saliency-map deep-learning self-attention seq2seq-pytorch word-embeddings document-embeddings recurrent-neural-networks hierarchical-attention-network
Created 2017-03-29
105 commits to master branch, last one 4 years ago
NVlabs
GCVit NVlabs
50
415
other
10
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
coco ade20k backbone imagenet pre-train deep-learning self-attention object-detection pre-trained-model vision-transformer visual-recognition semantic-segmentation imagenet-classification
Created 2022-06-18
113 commits to main branch, last one 5 months ago
binli123
dsmil-wsi binli123
84
321
mit
0
DSMIL: Dual-stream multiple instance learning networks for tumor detection in Whole Slide Image
pytorch transformer deep-learning histopathology self-attention tumor-detection visiontransformer whole-slide-image whole-slide-imaging deep-neural-networks self-supervised-learning semi-supervised-learning multiple-instance-learning weakly-supervised-learning
Created 2020-11-05
131 commits to master branch, last one 2 months ago
jw9730
tokengt jw9730
43
304
mit
9
[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch
gnn graph pytorch hypergraph transformer equivariance self-attention
Created 2022-06-29
32 commits to main branch, last one about a year ago
fudan-zvg
SOFT fudan-zvg
24
298
mit
8
[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
transformer softmax-free self-attention linear-complexity linear-transformer
Created 2021-09-11
72 commits to master branch, last one 2 months ago
WenjieDu
SAITS WenjieDu
48
276
mit
5
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-seri...
impute pytorch attention imputation time-series transformer deep-learning interpolation missing-values self-attention incomplete-data imputation-model machine-learning irregular-sampling partially-observed attention-mechanism incomplete-time-series time-series-imputation partially-observed-data partially-observed-time-series
Created 2021-12-07
79 commits to main branch, last one about a month ago
wenwenyu
MASTER-pytorch wenwenyu
55
276
mit
7
Code for the paper "MASTER: Multi-Aspect Non-local Network for Scene Text Recognition" (Pattern Recognition 2021)
ocr transformer self-attention non-local-network scene-text-recognition
Created 2021-03-31
37 commits to main branch, last one 2 years ago
aravindsankar28
DySAT aravindsankar28
46
272
unknown
4
Representation learning on dynamic graphs using self-attention networks
dynamic-graphs self-attention graph-embedding graph-neural-network
Created 2019-07-21
3 commits to master branch, last one 4 years ago
alohays
awesome-visual-representation-learning-with-transformers alohays
36
263
mit
14
Awesome Transformers (self-attention) in Computer Vision
awesome-list transformers self-attention computer-vision vision-transformer representation-learning
Created 2020-10-18
33 commits to main branch, last one 2 years ago
wangxiao5791509
MultiModal_BigModels_Survey wangxiao5791509
16
255
unknown
9
[MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models
audio depth radar review survey big-models multi-modal point-cloud event-camera pengchenglab pre-training transformers rgb-text-audio self-attention anhui-university natural-language thermal-infrared
Created 2021-12-13
175 commits to main branch, last one a day ago
GuanRunwei
Awesome-Vision-Transformer-Collection GuanRunwei
18
189
unknown
6
Variants of Vision Transformer and its downstream tasks
awesome backbone tracking detection segmentation deep-learning explainable-ai self-attention computer-vision pose-estimation generative-model lidar-point-cloud self-supervised-learning
Created 2021-11-07
69 commits to main branch, last one about a year ago