82 results found Sort:

datawhalechina
leedl-tutorial datawhalechina
2.9k
14.0k
other
282
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
cnn gan rnn bert chatgpt pruning tutorial diffusion transformer deep-learning leedl-tutorial self-attention machine-learning transfer-learning network-compression reinforcement-learning
Created 2019-07-02
584 commits to master branch, last one 2 days ago
zhouhaoyi
Informer2020 zhouhaoyi
1.1k
5.5k
apache-2.0
39
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
pytorch forecasting time-series transformer deep-learning self-attention
Created 2020-12-07
158 commits to main branch, last one about a year ago
cmhungsteve
Awesome-Transformer-Attention cmhungsteve
490
4.7k
unknown
130
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
vit detr papers transformer awesome-list transformers deep-learning self-attention transformer-cv computer-vision transformer-models vision-transformer visual-transformer attention-mechanism transformer-awesome transformer-with-cv attention-mechanisms transformer-architecture
Created 2021-09-15
1,600 commits to main branch, last one 4 months ago
PetarV-
GAT PetarV-
650
3.2k
mit
45
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
python tensorflow self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-02-01
21 commits to master branch, last one 3 years ago
Diego999
pyGAT Diego999
691
2.9k
mit
17
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
python pytorch self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-03-02
36 commits to master branch, last one 3 years ago
gordicaleksa
pytorch-GAT gordicaleksa
333
2.5k
mit
46
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...
gat python jupyter pytorch attention pytorch-gat gat-tutorial deep-learning self-attention attention-mechanism pytorch-implementation graph-attention-network graph-attention-networks
Created 2020-12-26
110 commits to main branch, last one 3 years ago
github
CodeSearchNet github
386
2.2k
mit
60
Datasets, tools, and benchmarks for representation learning of code.
ml cnn nlp rnn bert data python datasets open-data tensorflow data-science deep-learning self-attention neural-networks machine-learning nlp-machine-learning representation-learning natural-language-processing programming-language-theory machine-learning-on-source-code
This repository has been archived (exclude archived)
Created 2019-02-28
286 commits to master branch, last one 2 years ago
microsoft
DeBERTa microsoft
229
2.0k
mit
41
The implementation of DeBERTa
bert roberta deeplearning language-model self-attention transformer-encoder representation-learning natural-language-understanding
Created 2020-06-08
55 commits to master branch, last one about a year ago
speedinghzl
CCNet speedinghzl
276
1.4k
mit
29
CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).
pytorch cityscape segmentation scene-parsing self-attention semantic-segmentation
Created 2018-11-26
71 commits to master branch, last one 3 years ago
DirtyHarryLYL
Transformer-in-Vision DirtyHarryLYL
144
1.3k
unknown
87
Recent Transformer-based CV and related works.
paper multi-modal transformer deep-learning self-attention computer-vision visual-language vision-transformers
Created 2021-02-11
828 commits to main branch, last one about a year ago
The-AI-Summer
self-attention-cv The-AI-Summer
154
1.2k
mit
20
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
attention transformer transformers deep-learning self-attention machine-learning attention-mechanism artificial-intelligence machine-learning-algorithms
Created 2021-01-31
72 commits to main branch, last one 3 years ago
Separius
awesome-fast-attention Separius
108
990
gpl-3.0
32
list of efficient attention modules
awesome reformer attention linformer longformer transformer self-attention multihead-attention transformer-network attention-is-all-you-need
This repository has been archived (exclude archived)
Created 2020-07-31
46 commits to master branch, last one 3 years ago
brightmart
bert_language_understanding brightmart
211
960
unknown
49
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need
Created 2018-10-23
101 commits to master branch, last one 6 years ago
NVlabs
MambaVision NVlabs
43
841
other
17
Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
mamba transformers deep-learning hybrid-models self-attention foundation-models vision-transformer visual-recognition image-classification huggingface-transformers
Created 2024-06-10
40 commits to main branch, last one about a month ago
prakashpandey9
Text-Classification-Pytorch prakashpandey9
239
809
mit
21
Text classification using deep learning models in Pytorch
glove pytorch rnn-model lstm-model self-attention attention-model text-classification sentiment-classification
Created 2018-06-21
22 commits to master branch, last one 6 years ago
xxxnell
how-do-vits-work xxxnell
79
806
apache-2.0
7
(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
pytorch transformer loss-landscape self-attention vision-transformer
Created 2021-03-09
129 commits to transformer branch, last one 2 years ago
NVlabs
FasterViT NVlabs
62
797
other
17
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
coco ade20k backbone image-net deep-learning self-attention object-detection foundation-models pre-trained-model vision-transformer visual-recognition image-classification semantic-segmentation
Created 2023-05-19
275 commits to main branch, last one 6 months ago
kaituoxu
Speech-Transformer kaituoxu
196
772
unknown
29
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
asr pytorch attention end-to-end transformer self-attention attention-is-all-you-need
Created 2018-11-22
23 commits to master branch, last one about a year ago
daiquocnguyen
Graph-Transformer daiquocnguyen
79
654
apache-2.0
10
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
transformer self-attention node-embeddings graph-embeddings graph-transformer transformer-models graph-deep-learning text-classification graph-classification graph-neural-networks graph-machine-learning graph-representation-learning
Created 2019-08-03
181 commits to master branch, last one 2 years ago
NVlabs
FAN NVlabs
28
469
other
21
Official PyTorch implementation of Fully Attentional Networks
coco backbone imagenet pre-train cityscapes corruption deep-learning self-attention visual-grouping object-detection visual-recognition out-of-distribution vision-transformers image-classification semantic-segmentation information-bottleneck
Created 2022-04-20
18 commits to master branch, last one 2 years ago
Tixierae
deep_learning_NLP Tixierae
104
437
unknown
29
Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP
nlp nmt keras numpy doc2vec python3 pytorch skipgram word2vec attention cnn-keras saliency-map deep-learning self-attention seq2seq-pytorch word-embeddings document-embeddings recurrent-neural-networks hierarchical-attention-network
Created 2017-03-29
105 commits to master branch, last one 4 years ago
NVlabs
GCVit NVlabs
48
426
other
10
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
coco ade20k backbone imagenet pre-train deep-learning self-attention object-detection pre-trained-model vision-transformer visual-recognition semantic-segmentation imagenet-classification
Created 2022-06-18
113 commits to main branch, last one 11 months ago
binli123
dsmil-wsi binli123
88
378
mit
0
DSMIL: Dual-stream multiple instance learning networks for tumor detection in Whole Slide Image
pytorch transformer deep-learning histopathology self-attention tumor-detection visiontransformer whole-slide-image whole-slide-imaging deep-neural-networks self-supervised-learning semi-supervised-learning multiple-instance-learning weakly-supervised-learning
Created 2020-11-05
131 commits to master branch, last one 8 months ago
WenjieDu
SAITS WenjieDu
51
336
mit
6
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-seri...
impute pytorch attention imputation time-series transformer deep-learning interpolation missing-values self-attention incomplete-data imputation-model machine-learning irregular-sampling partially-observed attention-mechanism incomplete-time-series time-series-imputation partially-observed-data partially-observed-time-series
Created 2021-12-07
84 commits to main branch, last one 3 months ago
jw9730
tokengt jw9730
45
320
mit
9
[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch
gnn graph pytorch hypergraph transformer equivariance self-attention
Created 2022-06-29
32 commits to main branch, last one about a year ago
fudan-zvg
SOFT fudan-zvg
25
306
mit
8
[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
transformer softmax-free self-attention linear-complexity linear-transformer
Created 2021-09-11
72 commits to master branch, last one 8 months ago
aravindsankar28
DySAT aravindsankar28
43
282
unknown
5
Representation learning on dynamic graphs using self-attention networks
dynamic-graphs self-attention graph-embedding graph-neural-network
Created 2019-07-21
3 commits to master branch, last one 4 years ago
wangxiao5791509
MultiModal_BigModels_Survey wangxiao5791509
17
280
unknown
9
[MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models
audio depth radar review survey big-models multi-modal point-cloud event-camera pengchenglab pre-training transformers rgb-text-audio self-attention anhui-university natural-language thermal-infrared
Created 2021-12-13
210 commits to main branch, last one 7 days ago
wenwenyu
MASTER-pytorch wenwenyu
52
279
mit
7
Code for the paper "MASTER: Multi-Aspect Non-local Network for Scene Text Recognition" (Pattern Recognition 2021)
ocr transformer self-attention non-local-network scene-text-recognition
Created 2021-03-31
37 commits to main branch, last one 2 years ago
alohays
awesome-visual-representation-learning-with-transformers alohays
38
268
mit
14
Awesome Transformers (self-attention) in Computer Vision
awesome-list transformers self-attention computer-vision vision-transformer representation-learning
Created 2020-10-18
33 commits to main branch, last one 3 years ago