273 results found Sort:

lucidrains
vit-pytorch lucidrains
2.8k
18.4k
mit
145
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
transformers computer-vision attention-mechanism image-classification artificial-intelligence
Created 2020-10-03
307 commits to main branch, last one 20 days ago
BlinkDL
RWKV-LM BlinkDL
812
11.8k
apache-2.0
136
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...
gpt rnn lstm rwkv gpt-2 gpt-3 chatgpt pytorch transformer transformers deep-learning language-model linear-attention attention-mechanism
Created 2021-08-08
614 commits to main branch, last one 21 hours ago
brightmart
text_classification brightmart
2.6k
7.8k
mit
299
all kinds of text classification models and more with deep learning
nlp textcnn textrnn fasttext tensorflow multi-class multi-label classification memory-networks attention-mechanism text-classification sentence-classification convolutional-neural-networks
Created 2017-05-30
325 commits to master branch, last one about a year ago
lucidrains
DALLE-pytorch lucidrains
639
5.5k
mit
96
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
multi-modal transformers deep-learning text-to-image attention-mechanism artificial-intelligence
Created 2021-01-05
540 commits to main branch, last one 8 months ago
benedekrozemberczki
awesome-graph-classification benedekrozemberczki
744
4.7k
cc0-1.0
217
A collection of important graph embedding, classification and representation learning papers with implementations.
netlsd deepwalk node2vec graph2vec graph-kernel graph-kernels kernel-methods node-embedding graph-embedding network-embedding weisfeiler-lehman deep-graph-kernels attention-mechanism graph-classification structural-attention graph-attention-model classification-algorithm graph-attention-networks graph-convolutional-networks graph-representation-learning
Created 2018-07-14
422 commits to master branch, last one about a year ago
cmhungsteve
Awesome-Transformer-Attention cmhungsteve
475
4.3k
unknown
122
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
vit detr papers transformer awesome-list transformers deep-learning self-attention transformer-cv computer-vision transformer-models vision-transformer visual-transformer attention-mechanism transformer-awesome transformer-with-cv attention-mechanisms transformer-architecture
Created 2021-09-15
1,594 commits to main branch, last one 10 days ago
lucidrains
x-transformers lucidrains
361
4.2k
mit
52
A simple but complete full-attention transformer with a set of promising experimental features from various papers
transformers deep-learning attention-mechanism artificial-intelligence
Created 2020-10-24
515 commits to main branch, last one 13 hours ago
Kyubyong
transformer Kyubyong
1.3k
4.2k
apache-2.0
110
A TensorFlow Implementation of the Transformer: Attention Is All You Need
transformer translation implementation attention-mechanism attention-is-all-you-need
Created 2017-06-17
37 commits to master branch, last one 4 years ago
PetarV-
GAT PetarV-
639
3.1k
mit
45
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
python tensorflow self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-02-01
21 commits to master branch, last one 3 years ago
zzw922cn
awesome-speech-recognition-speech-synthesis-papers zzw922cn
508
2.9k
mit
187
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
cnn dnn rnn tts papers roadmap seq2seq timit-dataset acoustic-model language-model neural-network diffusion-models speech-synthesis voice-conversion speech-recognition attention-mechanism speaker-verification recognition-synthesis singing-voice-synthesis automatic-speech-recognition
Created 2017-04-28
181 commits to master branch, last one 7 months ago
Diego999
pyGAT Diego999
686
2.8k
mit
17
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
python pytorch self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-03-02
36 commits to master branch, last one 2 years ago
philipperemy
keras-attention philipperemy
676
2.8k
apache-2.0
78
Keras Attention Layer (Luong and Bahdanau scores).
keras deep-learning attention-model attention-mechanism keras-neural-networks
Created 2017-05-23
102 commits to master branch, last one 8 months ago
sgrvinod
a-PyTorch-Tutorial-to-Image-Captioning sgrvinod
715
2.7k
mit
24
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
mscoco pytorch computer-vision encoder-decoder image-captioning pytorch-tutorial attention-mechanism show-attend-and-tell
Created 2018-05-30
75 commits to master branch, last one 3 years ago
gordicaleksa
pytorch-GAT gordicaleksa
314
2.3k
mit
46
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...
gat python jupyter pytorch attention pytorch-gat gat-tutorial deep-learning self-attention attention-mechanism pytorch-implementation graph-attention-network graph-attention-networks
Created 2020-12-26
110 commits to main branch, last one 3 years ago
lucidrains
reformer-pytorch lucidrains
256
2.1k
mit
53
Reformer, the efficient Transformer, in Pytorch
pytorch transformers machine-learning attention-mechanism artificial-intelligence
Created 2020-01-09
249 commits to master branch, last one 11 months ago
linto-ai
whisper-timestamped linto-ai
134
1.6k
agpl-3.0
24
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
asr python speech python3 pytorch whisper transformers deep-learning speech-to-text attention-model machine-learning attention-network attention-seq2seq speech-processing speech-recognition attention-mechanism multilingual-models speaker-diarization attention-visualization attention-is-all-you-need
Created 2023-01-13
241 commits to master branch, last one about a month ago
lucidrains
lambda-networks lucidrains
158
1.5k
mit
46
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
attention deep-learning computer-vision attention-mechanism artificial-intelligence
Created 2020-10-08
31 commits to main branch, last one 3 years ago
lucidrains
alphafold2 lucidrains
254
1.5k
mit
66
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
deep-learning protein-folding attention-mechanism artificial-intelligence
Created 2020-12-01
538 commits to main branch, last one about a year ago
charlesXu86
Chatbot_CN charlesXu86
433
1.3k
apache-2.0
46
基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口
ir ner nlg nlu chatbot-cn tensorflow slot-filling text-correct deep-learning django-restful recommendation knowledge-graph dialogue-systems intent-detection oriented-dialogs sentiment-analysis tenserflow-serving attention-mechanism text-classification reinforcement-learning
Created 2018-08-01
4 commits to master branch, last one 2 years ago
awslabs
sockeye awslabs
327
1.2k
apache-2.0
51
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
pytorch seq2seq sockeye transformer translation deep-learning attention-model encoder-decoder machine-learning attention-mechanism machine-translation transformer-network deep-neural-networks sequence-to-sequence transformer-architecture attention-is-all-you-need neural-machine-translation sequence-to-sequence-models
Created 2017-06-08
834 commits to main branch, last one 9 days ago
lucidrains
flamingo-pytorch lucidrains
60
1.2k
mit
21
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
transformers deep-learning attention-mechanism artificial-intelligence visual-question-answering
Created 2022-04-28
36 commits to main branch, last one about a year ago
The-AI-Summer
self-attention-cv The-AI-Summer
151
1.1k
mit
20
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
attention transformer transformers deep-learning self-attention machine-learning attention-mechanism artificial-intelligence machine-learning-algorithms
Created 2021-01-31
72 commits to main branch, last one 2 years ago
lucidrains
soundstorm-pytorch lucidrains
76
1.1k
mit
51
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
transformers deep-learning audio-generation non-autoregressive attention-mechanism artificial-intelligence
Created 2023-05-17
86 commits to main branch, last one 27 days ago
richliao
textClassifier richliao
379
1.1k
apache-2.0
44
Text classifier for Hierarchical Attention Networks for Document Classification
attention-mechanism text-classification recurrent-neural-networks convolutional-neural-networks hierarchical-attention-networks
Created 2016-12-29
19 commits to master branch, last one 2 years ago
lucidrains
performer-pytorch lucidrains
143
1.1k
mit
17
An implementation of Performer, a linear attention-based transformer, in Pytorch
attention transformers deep-learning attention-mechanism artificial-intelligence
Created 2020-10-03
124 commits to main branch, last one 2 years ago
lucidrains
perceiver-pytorch lucidrains
133
1.1k
mit
31
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
deep-learning attention-mechanism artificial-intelligence
Created 2021-03-05
74 commits to main branch, last one 9 months ago
cedrickchee
awesome-transformer-nlp cedrickchee
127
1.0k
mit
39
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
nlp bert gpt-2 gpt-3 gpt-4 llama xlnet awesome chatgpt transformer awesome-list language-model neural-networks transfer-learning attention-mechanism natural-language-processing pre-trained-language-models
Created 2019-01-13
256 commits to master branch, last one 12 days ago
lucidrains
CoCa-pytorch lucidrains
88
990
mit
14
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
multimodal transformers deep-learning image-to-text attention-mechanism contrastive-learning artificial-intelligence
Created 2022-05-05
25 commits to main branch, last one 5 months ago
yunjey
show-attend-and-tell yunjey
324
905
mit
38
TensorFlow Implementation of "Show, Attend and Tell"
tensorflow image-captioning attention-mechanism mscoco-image-dataset show-attend-and-tell
Created 2016-09-10
165 commits to master branch, last one 6 years ago
atulkum
pointer_summarizer atulkum
245
898
apache-2.0
16
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
nlp seq2seq-attn deep-learning summarization pointer-networks attention-mechanism pytorch-implmention
Created 2018-04-16
94 commits to master branch, last one about a year ago