327 results found Sort:

lucidrains
vit-pytorch lucidrains
3.2k
22.3k
mit
157
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
transformers computer-vision attention-mechanism image-classification artificial-intelligence
Created 2020-10-03
341 commits to main branch, last one 29 days ago
BlinkDL
RWKV-LM BlinkDL
905
13.5k
apache-2.0
132
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a...
gpt rnn lstm rwkv gpt-2 gpt-3 chatgpt pytorch transformer transformers deep-learning language-model linear-attention attention-mechanism
Created 2021-08-08
712 commits to main branch, last one 14 days ago
brightmart
text_classification brightmart
2.6k
7.9k
mit
298
all kinds of text classification models and more with deep learning
nlp textcnn textrnn fasttext tensorflow multi-class multi-label classification memory-networks attention-mechanism text-classification sentence-classification convolutional-neural-networks
Created 2017-05-30
325 commits to master branch, last one 2 years ago
lucidrains
DALLE-pytorch lucidrains
639
5.6k
mit
95
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
multi-modal transformers deep-learning text-to-image attention-mechanism artificial-intelligence
Created 2021-01-05
540 commits to main branch, last one about a year ago
lucidrains
x-transformers lucidrains
446
5.2k
mit
56
A concise but complete full-attention transformer with a set of promising experimental features from various papers
transformers deep-learning attention-mechanism artificial-intelligence
Created 2020-10-24
688 commits to main branch, last one 15 days ago
cmhungsteve
Awesome-Transformer-Attention cmhungsteve
493
4.8k
unknown
128
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
vit detr papers transformer awesome-list transformers deep-learning self-attention transformer-cv computer-vision transformer-models vision-transformer visual-transformer attention-mechanism transformer-awesome transformer-with-cv attention-mechanisms transformer-architecture
Created 2021-09-15
1,600 commits to main branch, last one 8 months ago
benedekrozemberczki
awesome-graph-classification benedekrozemberczki
740
4.8k
cc0-1.0
214
A collection of important graph embedding, classification and representation learning papers with implementations.
netlsd deepwalk node2vec graph2vec graph-kernel graph-kernels kernel-methods node-embedding graph-embedding network-embedding weisfeiler-lehman deep-graph-kernels attention-mechanism graph-classification structural-attention graph-attention-model classification-algorithm graph-attention-networks graph-convolutional-networks graph-representation-learning
Created 2018-07-14
422 commits to master branch, last one 2 years ago
kyegomez
swarms kyegomez
542
4.8k
apache-2.0
58
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai
ai gpt4 agents swarms chatgpt gpt4all langchain prompting multimodal huggingface multi-modality prompt-toolkit langchain-python machine-learning tree-of-thoughts prompt-engineering transformer-models attention-mechanism multi-modal-imaging artificial-intelligence
Created 2023-05-11
3,554 commits to master branch, last one 20 hours ago
Kyubyong
transformer Kyubyong
1.3k
4.3k
apache-2.0
109
A TensorFlow Implementation of the Transformer: Attention Is All You Need
transformer translation implementation attention-mechanism attention-is-all-you-need
Created 2017-06-17
37 commits to master branch, last one 5 years ago
PetarV-
GAT PetarV-
659
3.3k
mit
44
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
python tensorflow self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-02-01
21 commits to master branch, last one 4 years ago
zzw922cn
awesome-speech-recognition-speech-synthesis-papers zzw922cn
514
3.0k
mit
186
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
cnn dnn rnn tts papers roadmap seq2seq timit-dataset acoustic-model language-model neural-network diffusion-models speech-synthesis voice-conversion speech-recognition attention-mechanism speaker-verification recognition-synthesis singing-voice-synthesis automatic-speech-recognition
Created 2017-04-28
181 commits to master branch, last one about a year ago
Diego999
pyGAT Diego999
695
3.0k
mit
15
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
python pytorch self-attention neural-networks attention-mechanism graph-attention-networks
Created 2018-03-02
36 commits to master branch, last one 3 years ago
sgrvinod
a-PyTorch-Tutorial-to-Image-Captioning sgrvinod
721
2.8k
mit
23
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
mscoco pytorch computer-vision encoder-decoder image-captioning pytorch-tutorial attention-mechanism show-attend-and-tell
Created 2018-05-30
75 commits to master branch, last one 4 years ago
philipperemy
keras-attention philipperemy
670
2.8k
apache-2.0
76
Keras Attention Layer (Luong and Bahdanau scores).
keras deep-learning attention-model attention-mechanism keras-neural-networks
Created 2017-05-23
102 commits to master branch, last one about a year ago
gordicaleksa
pytorch-GAT gordicaleksa
335
2.5k
mit
47
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...
gat python jupyter pytorch attention pytorch-gat gat-tutorial deep-learning self-attention attention-mechanism pytorch-implementation graph-attention-network graph-attention-networks
Created 2020-12-26
110 commits to main branch, last one 4 years ago
linto-ai
whisper-timestamped linto-ai
179
2.3k
agpl-3.0
34
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
asr python speech python3 pytorch whisper transformers deep-learning speech-to-text attention-model machine-learning attention-network attention-seq2seq speech-processing speech-recognition attention-mechanism multilingual-models speaker-diarization attention-visualization attention-is-all-you-need
Created 2023-01-13
256 commits to master branch, last one 3 days ago
lucidrains
reformer-pytorch lucidrains
255
2.2k
mit
52
Reformer, the efficient Transformer, in Pytorch
pytorch transformers machine-learning attention-mechanism artificial-intelligence
Created 2020-01-09
249 commits to master branch, last one about a year ago
lucidrains
alphafold2 lucidrains
263
1.6k
mit
64
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
deep-learning protein-folding attention-mechanism artificial-intelligence
Created 2020-12-01
538 commits to main branch, last one 2 years ago
lucidrains
lambda-networks lucidrains
157
1.5k
mit
45
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
attention deep-learning computer-vision attention-mechanism artificial-intelligence
Created 2020-10-08
31 commits to main branch, last one 4 years ago
lucidrains
soundstorm-pytorch lucidrains
91
1.5k
mit
50
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
transformers deep-learning audio-generation non-autoregressive attention-mechanism artificial-intelligence
Created 2023-05-17
94 commits to main branch, last one 5 months ago
charlesXu86
Chatbot_CN charlesXu86
432
1.3k
apache-2.0
44
基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口
ir ner nlg nlu chatbot-cn tensorflow slot-filling text-correct deep-learning django-restful recommendation knowledge-graph dialogue-systems intent-detection oriented-dialogs sentiment-analysis tenserflow-serving attention-mechanism text-classification reinforcement-learning
Created 2018-08-01
4 commits to master branch, last one 3 years ago
lucidrains
flamingo-pytorch lucidrains
62
1.2k
mit
21
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
transformers deep-learning attention-mechanism artificial-intelligence visual-question-answering
Created 2022-04-28
36 commits to main branch, last one 2 years ago
awslabs
sockeye awslabs
325
1.2k
apache-2.0
48
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
pytorch seq2seq sockeye transformer translation deep-learning attention-model encoder-decoder machine-learning attention-mechanism machine-translation transformer-network deep-neural-networks sequence-to-sequence transformer-architecture attention-is-all-you-need neural-machine-translation sequence-to-sequence-models
Created 2017-06-08
836 commits to main branch, last one 5 months ago
The-AI-Summer
self-attention-cv The-AI-Summer
154
1.2k
mit
19
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
attention transformer transformers deep-learning self-attention machine-learning attention-mechanism artificial-intelligence machine-learning-algorithms
Created 2021-01-31
72 commits to main branch, last one 3 years ago
lucidrains
perceiver-pytorch lucidrains
136
1.1k
mit
30
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
deep-learning attention-mechanism artificial-intelligence
Created 2021-03-05
74 commits to main branch, last one about a year ago
lucidrains
CoCa-pytorch lucidrains
89
1.1k
mit
13
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
multimodal transformers deep-learning image-to-text attention-mechanism contrastive-learning artificial-intelligence
Created 2022-05-05
25 commits to main branch, last one about a year ago
lucidrains
performer-pytorch lucidrains
145
1.1k
mit
17
An implementation of Performer, a linear attention-based transformer, in Pytorch
attention transformers deep-learning attention-mechanism artificial-intelligence
Created 2020-10-03
124 commits to main branch, last one 3 years ago
cedrickchee
awesome-transformer-nlp cedrickchee
131
1.1k
mit
42
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
nlp bert gpt-2 gpt-3 gpt-4 llama xlnet awesome chatgpt transformer awesome-list language-model neural-networks transfer-learning attention-mechanism natural-language-processing pre-trained-language-models
Created 2019-01-13
264 commits to master branch, last one 5 months ago
richliao
textClassifier richliao
378
1.1k
apache-2.0
42
Text classifier for Hierarchical Attention Networks for Document Classification
attention-mechanism text-classification recurrent-neural-networks convolutional-neural-networks hierarchical-attention-networks
Created 2016-12-29
19 commits to master branch, last one 3 years ago
SuperBruceJia
EEG-DL SuperBruceJia
229
1.0k
mit
21
A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.
cnn gcn gru rnn lstm resnet densenet eeg-data tensorflow transformer transformers deep-learning one-shot-learning residual-learning eeg-classification attention-mechanism eeg-signals-processing fully-convolutional-networks motor-imagery-classification graph-convolutional-neural-networks
Created 2020-04-30
107 commits to master branch, last one 2 years ago