48 results found Sort:

jadore801120
attention-is-all-you-need-pytorch jadore801120
2.0k
8.9k
mit
97
A PyTorch implementation of the Transformer model in "Attention is All You Need".
nlp pytorch attention deep-learning attention-is-all-you-need natural-language-processing
Created 2017-06-14
196 commits to master branch, last one 3 years ago
Kyubyong
transformer Kyubyong
1.3k
4.3k
apache-2.0
110
A TensorFlow Implementation of the Transformer: Attention Is All You Need
transformer translation implementation attention-mechanism attention-is-all-you-need
Created 2017-06-17
37 commits to master branch, last one 5 years ago
linto-ai
whisper-timestamped linto-ai
160
2.1k
agpl-3.0
31
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
asr python speech python3 pytorch whisper transformers deep-learning speech-to-text attention-model machine-learning attention-network attention-seq2seq speech-processing speech-recognition attention-mechanism multilingual-models speaker-diarization attention-visualization attention-is-all-you-need
Created 2023-01-13
251 commits to master branch, last one 8 days ago
awslabs
sockeye awslabs
323
1.2k
apache-2.0
50
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
pytorch seq2seq sockeye transformer translation deep-learning attention-model encoder-decoder machine-learning attention-mechanism machine-translation transformer-network deep-neural-networks sequence-to-sequence transformer-architecture attention-is-all-you-need neural-machine-translation sequence-to-sequence-models
Created 2017-06-08
836 commits to main branch, last one about a month ago
Separius
awesome-fast-attention Separius
108
990
gpl-3.0
32
list of efficient attention modules
awesome reformer attention linformer longformer transformer self-attention multihead-attention transformer-network attention-is-all-you-need
This repository has been archived (exclude archived)
Created 2020-07-31
46 commits to master branch, last one 3 years ago
brightmart
bert_language_understanding brightmart
211
960
unknown
49
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need
Created 2018-10-23
101 commits to master branch, last one 6 years ago
kaituoxu
Speech-Transformer kaituoxu
196
772
unknown
29
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
asr pytorch attention end-to-end transformer self-attention attention-is-all-you-need
Created 2018-11-22
23 commits to master branch, last one about a year ago
lsdefine
attention-is-all-you-need-keras lsdefine
188
709
unknown
26
A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
keras deep-learning keras-tensorflow attention-seq2seq attention-is-all-you-need
Created 2018-03-16
29 commits to master branch, last one 3 years ago
kyegomez
LongNet kyegomez
64
691
apache-2.0
18
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
gpt3 gpt4 chatgpt attention transformer context-length machine-learning attention-mechanisms artificial-intelligence attention-is-all-you-need
Created 2023-07-06
181 commits to master branch, last one 11 months ago
hkproj
pytorch-transformer hkproj
271
653
unknown
12
Attention is all you need implementation
pytorch transformer paper-implementations attention-is-all-you-need
Created 2023-05-18
53 commits to main branch, last one 12 months ago
sooftware
kospeech sooftware
192
605
apache-2.0
21
Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.
asr las jasper e2e-asr pytorch seq2seq conformer end-to-end las-models ksponspeech transformer korean-speech speech-recognition attention-is-all-you-need
Created 2019-10-30
2,212 commits to latest branch, last one about a year ago
FreedomIntelligence
TextClassificationBenchmark FreedomIntelligence
138
602
mit
32
A Benchmark of Text Classification in PyTorch
cnn crnn lstm rcnn capusle pytorch quantum benchmark cnn-classification text-classification lstm-sentiment-analysis attention-is-all-you-need
Created 2017-12-13
205 commits to master branch, last one 7 months ago
lvapeab
nmt-keras lvapeab
130
533
mit
26
Neural Machine Translation with Keras
gru nmt keras theano web-demo tensorflow transformer deep-learning lstm-networks attention-model machine-learning attention-seq2seq attention-mechanism machine-translation sequence-to-sequence attention-is-all-you-need neural-machine-translation
Created 2016-11-22
681 commits to master branch, last one 3 years ago
feifeibear
long-context-attention feifeibear
25
374
apache-2.0
4
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
pytorch llm-training llm-inference ring-attention deepspeed-ulysses attention-is-all-you-need
Created 2024-03-27
216 commits to main branch, last one 3 days ago
kyegomez
CM3Leon kyegomez
18
363
mit
22
An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images
dalle attention multimodal multimodality imagegeneration multimodal-learning attention-is-all-you-need
Created 2023-07-14
73 commits to main branch, last one 11 months ago
kyegomez
ScreenAI kyegomez
30
301
mit
9
Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"
ai ml gpt-4 pytorch attention tensorflow machine-learning artificial-intelligence attention-is-all-you-need
Created 2024-02-08
20 commits to main branch, last one 9 months ago
sled-group
InfEdit sled-group
8
292
other
5
[CVPR 2024] Official implementation of CVPR 2024 paper: "Inversion-Free Image Editing with Natural Language"
inversion image-edit diffusion-models prompt-to-prompt consistency-models attention-is-all-you-need
Created 2023-12-04
27 commits to main branch, last one 6 months ago
kyegomez
PALM-E kyegomez
45
273
apache-2.0
5
Implementation of "PaLM-E: An Embodied Multimodal Language Model"
gpt4 multimodal deeplearning deep-learning attention-mechanism artificial-intelligence attention-is-all-you-need artificial-neural-networks
Created 2023-06-09
190 commits to main branch, last one 10 months ago
sgrvinod
a-PyTorch-Tutorial-to-Transformers sgrvinod
46
271
mit
7
Attention Is All You Need | a PyTorch Tutorial to Transformers
pytorch transformer pytorch-tutorial transformer-tutorial transformer-architecture attention-is-all-you-need
Created 2020-01-30
19 commits to master branch, last one 11 months ago
leviswind
pytorch-transformer leviswind
58
240
unknown
3
pytorch implementation of Attention is all you need
pytorch transformer translation attention-is-all-you-need
Created 2018-01-05
8 commits to master branch, last one 6 years ago
brandokoch
attention-is-all-you-need-paper brandokoch
47
232
mit
3
Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.
pytorch transformer deep-learning machine-learning attention-is-all-you-need
Created 2021-12-02
15 commits to master branch, last one about a year ago
hkproj
transformer-from-scratch-notes hkproj
51
228
unknown
3
Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
notes study-notes transformer attention-model transformer-architecture attention-is-all-you-need
Created 2023-05-25
6 commits to main branch, last one about a year ago
kyegomez
RT-X kyegomez
19
178
mit
8
Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"
gpt4 vision gpt4all multimodal attention-model computer-vision vision-transformer artificial-intelligence attention-is-all-you-need
Created 2023-10-04
119 commits to main branch, last one 8 months ago
kyegomez
MambaTransformer kyegomez
17
173
mit
4
Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
ai ssm gpt4 rnns zeta pytorch language multimodal tensorflow neural-network neural-networks machine-learning attention-mechanisms artificial-intelligence attention-is-all-you-need recurrent-neural-networks
Created 2024-01-13
21 commits to main branch, last one 8 months ago
Shuijing725
CrowdNav_Prediction_AttnGraph Shuijing725
31
172
mit
5
[ICRA 2023] Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graph
deep-learning crowd-navigation collision-avoidance trajectory-prediction reinforcement-learning human-robot-interaction attention-is-all-you-need deep-reinforcement-learning
Created 2023-01-03
17 commits to main branch, last one 8 months ago
kyegomez
Jamba kyegomez
12
142
mit
6
PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
ai ml gpt ssm transformers attention-mechanism attention-mechanisms attention-is-all-you-need artificial-neural-networks
Created 2024-04-01
10 commits to main branch, last one 8 months ago
OutofAi
StableFace OutofAi
14
140
mit
2
Build your own Face App with Stable Diffusion 2.1
faceapp stableface generativeai transformers generative-ai image-editing prompt2prompt ddim-inversion diffusion-models stable-diffusion image-editing-app photo-editing-app pivotal-inversion image-reconstruction stable-diffusion-2-1 sampling-distribution attention-is-all-you-need
Created 2024-06-29
54 commits to main branch, last one 2 months ago
tnq177
transformers_without_tears tnq177
18
130
mit
8
Transformers without Tears: Improving the Normalization of Self-Attention
pytorch transformer machine-translation attention-is-all-you-need
This repository has been archived (exclude archived)
Created 2019-10-15
17 commits to master branch, last one 6 months ago
jshuadvd
LongRoPE jshuadvd
14
125
unknown
6
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
ai gpt llm nlp natural tokenizers tokenization transformers deep-learning language-model machine-learning attention-mechanisms artificial-intelligence transformer-architecture attention-is-all-you-need natural-language-inference natural-language-processing natural-language-procressing natural-language-understanding
Created 2024-03-06
266 commits to master branch, last one 4 months ago
alexivaner
Deep-Learning-Based-Radio-Signal-Classification alexivaner
25
95
mit
3
Final Project for AI Wireless
radio resnet signal classification neural-network signal-processing attention-is-all-you-need
Created 2020-12-04
83 commits to main branch, last one 3 years ago