310 results found Sort:

lucidrains
vit-pytorch lucidrains
3.1k
21.1k
mit
156
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
transformers computer-vision attention-mechanism image-classification artificial-intelligence
Created 2020-10-03
336 commits to main branch, last one 15 hours ago
BlinkDL
RWKV-LM BlinkDL
876
12.8k
apache-2.0
132
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...
gpt rnn lstm rwkv gpt-2 gpt-3 chatgpt pytorch transformer transformers deep-learning language-model linear-attention attention-mechanism
Created 2021-08-08
682 commits to main branch, last one a day ago
brightmart
text_classification brightmart
2.6k
7.9k
mit
299
all kinds of text classification models and more with deep learning
nlp textcnn textrnn fasttext tensorflow multi-class multi-label classification memory-networks attention-mechanism text-classification sentence-classification convolutional-neural-networks
Created 2017-05-30
325 commits to master branch, last one 2 years ago
lucidrains
DALLE-pytorch lucidrains
641
5.6k
mit
97
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
multi-modal transformers deep-learning text-to-image attention-mechanism artificial-intelligence
Created 2021-01-05
540 commits to main branch, last one about a year ago
lucidrains
x-transformers lucidrains
425
4.9k
mit
57
A concise but complete full-attention transformer with a set of promising experimental features from various papers
transformers deep-learning attention-mechanism artificial-intelligence
Created 2020-10-24
630 commits to main branch, last one a day ago
benedekrozemberczki
awesome-graph-classification benedekrozemberczki
741
4.8k
cc0-1.0
217
A collection of important graph embedding, classification and representation learning papers with implementations.
netlsd deepwalk node2vec graph2vec graph-kernel graph-kernels kernel-methods node-embedding graph-embedding network-embedding weisfeiler-lehman deep-graph-kernels attention-mechanism graph-classification structural-attention graph-attention-model classification-algorithm graph-attention-networks graph-convolutional-networks graph-representation-learning
Created 2018-07-14
422 commits to master branch, last one about a year ago
cmhungsteve
Awesome-Transformer-Attention cmhungsteve
490
4.7k
unknown
130
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
vit detr papers transformer awesome-list transformers deep-learning self-attention transformer-cv computer-vision transformer-models vision-transformer visual-transformer attention-mechanism transformer-awesome transformer-with-cv attention-mechanisms transformer-architecture
Created 2021-09-15
1,600 commits to main branch, last one 4 months ago
Kyubyong
transformer Kyubyong
1.3k
4.3k
apache-2.0
110
A TensorFlow Implementation of the Transformer: Attention Is All You Need
transformer translation implementation attention-mechanism attention-is-all-you-need
Created 2017-06-17
37 commits to master branch, last one 5 years ago
PetarV-
GAT PetarV-
652
3.3k
mit
45
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
python tensorflow self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-02-01
21 commits to master branch, last one 3 years ago
zzw922cn
awesome-speech-recognition-speech-synthesis-papers zzw922cn
515
3k
mit
187
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
cnn dnn rnn tts papers roadmap seq2seq timit-dataset acoustic-model language-model neural-network diffusion-models speech-synthesis voice-conversion speech-recognition attention-mechanism speaker-verification recognition-synthesis singing-voice-synthesis automatic-speech-recognition
Created 2017-04-28
181 commits to master branch, last one about a year ago
Diego999
pyGAT Diego999
691
2.9k
mit
17
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
python pytorch self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-03-02
36 commits to master branch, last one 3 years ago
philipperemy
keras-attention philipperemy
675
2.8k
apache-2.0
78
Keras Attention Layer (Luong and Bahdanau scores).
keras deep-learning attention-model attention-mechanism keras-neural-networks
Created 2017-05-23
102 commits to master branch, last one about a year ago
sgrvinod
a-PyTorch-Tutorial-to-Image-Captioning sgrvinod
717
2.8k
mit
24
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
mscoco pytorch computer-vision encoder-decoder image-captioning pytorch-tutorial attention-mechanism show-attend-and-tell
Created 2018-05-30
75 commits to master branch, last one 4 years ago
gordicaleksa
pytorch-GAT gordicaleksa
333
2.5k
mit
46
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...
gat python jupyter pytorch attention pytorch-gat gat-tutorial deep-learning self-attention attention-mechanism pytorch-implementation graph-attention-network graph-attention-networks
Created 2020-12-26
110 commits to main branch, last one 3 years ago
lucidrains
reformer-pytorch lucidrains
256
2.1k
mit
54
Reformer, the efficient Transformer, in Pytorch
pytorch transformers machine-learning attention-mechanism artificial-intelligence
Created 2020-01-09
249 commits to master branch, last one about a year ago
linto-ai
whisper-timestamped linto-ai
163
2.1k
agpl-3.0
31
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
asr python speech python3 pytorch whisper transformers deep-learning speech-to-text attention-model machine-learning attention-network attention-seq2seq speech-processing speech-recognition attention-mechanism multilingual-models speaker-diarization attention-visualization attention-is-all-you-need
Created 2023-01-13
252 commits to master branch, last one 15 days ago
kyegomez
swarms kyegomez
282
2.0k
agpl-3.0
36
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051935506503
ai gpt4 agents swarms chatgpt gpt4all langchain prompting multimodal huggingface multi-modality prompt-toolkit langchain-python machine-learning tree-of-thoughts prompt-engineering transformer-models attention-mechanism multi-modal-imaging artificial-intelligence
Created 2023-05-11
3,277 commits to master branch, last one 3 days ago
lucidrains
alphafold2 lucidrains
260
1.6k
mit
64
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
deep-learning protein-folding attention-mechanism artificial-intelligence
Created 2020-12-01
538 commits to main branch, last one 2 years ago
lucidrains
lambda-networks lucidrains
157
1.5k
mit
46
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
attention deep-learning computer-vision attention-mechanism artificial-intelligence
Created 2020-10-08
31 commits to main branch, last one 4 years ago
lucidrains
soundstorm-pytorch lucidrains
90
1.4k
mit
51
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
transformers deep-learning audio-generation non-autoregressive attention-mechanism artificial-intelligence
Created 2023-05-17
94 commits to main branch, last one about a month ago
charlesXu86
Chatbot_CN charlesXu86
433
1.3k
apache-2.0
46
基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口
ir ner nlg nlu chatbot-cn tensorflow slot-filling text-correct deep-learning django-restful recommendation knowledge-graph dialogue-systems intent-detection oriented-dialogs sentiment-analysis tenserflow-serving attention-mechanism text-classification reinforcement-learning
Created 2018-08-01
4 commits to master branch, last one 3 years ago
lucidrains
flamingo-pytorch lucidrains
59
1.2k
mit
21
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
transformers deep-learning attention-mechanism artificial-intelligence visual-question-answering
Created 2022-04-28
36 commits to main branch, last one 2 years ago
awslabs
sockeye awslabs
323
1.2k
apache-2.0
50
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
pytorch seq2seq sockeye transformer translation deep-learning attention-model encoder-decoder machine-learning attention-mechanism machine-translation transformer-network deep-neural-networks sequence-to-sequence transformer-architecture attention-is-all-you-need neural-machine-translation sequence-to-sequence-models
Created 2017-06-08
836 commits to main branch, last one about a month ago
The-AI-Summer
self-attention-cv The-AI-Summer
154
1.2k
mit
20
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
attention transformer transformers deep-learning self-attention machine-learning attention-mechanism artificial-intelligence machine-learning-algorithms
Created 2021-01-31
72 commits to main branch, last one 3 years ago
lucidrains
perceiver-pytorch lucidrains
134
1.1k
mit
31
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
deep-learning attention-mechanism artificial-intelligence
Created 2021-03-05
74 commits to main branch, last one about a year ago
lucidrains
performer-pytorch lucidrains
145
1.1k
mit
17
An implementation of Performer, a linear attention-based transformer, in Pytorch
attention transformers deep-learning attention-mechanism artificial-intelligence
Created 2020-10-03
124 commits to main branch, last one 2 years ago
lucidrains
CoCa-pytorch lucidrains
89
1.1k
mit
14
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
multimodal transformers deep-learning image-to-text attention-mechanism contrastive-learning artificial-intelligence
Created 2022-05-05
25 commits to main branch, last one about a year ago
cedrickchee
awesome-transformer-nlp cedrickchee
129
1.1k
mit
41
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
nlp bert gpt-2 gpt-3 gpt-4 llama xlnet awesome chatgpt transformer awesome-list language-model neural-networks transfer-learning attention-mechanism natural-language-processing pre-trained-language-models
Created 2019-01-13
264 commits to master branch, last one about a month ago
richliao
textClassifier richliao
378
1.1k
apache-2.0
43
Text classifier for Hierarchical Attention Networks for Document Classification
attention-mechanism text-classification recurrent-neural-networks convolutional-neural-networks hierarchical-attention-networks
Created 2016-12-29
19 commits to master branch, last one 3 years ago
SuperBruceJia
EEG-DL SuperBruceJia
225
977
mit
22
A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.
cnn gcn gru rnn lstm resnet densenet eeg-data tensorflow transformer transformers deep-learning one-shot-learning residual-learning eeg-classification attention-mechanism eeg-signals-processing fully-convolutional-networks motor-imagery-classification graph-convolutional-neural-networks
Created 2020-04-30
107 commits to master branch, last one about a year ago