8 results found Sort:

sooftware
conformer sooftware
176
960
apache-2.0
9
[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)
asr cnn conv speech pytorch augmented conformer convolution recognition transformer transformer-xl speech-recognition
Created 2021-01-21
94 commits to main branch, last one 11 months ago
sail-sg
Adan sail-sg
64
761
apache-2.0
7
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
mae moe vit adan gpt2 llms timm resnet fairseq pytorch convnext diffusion optimizer bert-model dreamfusion llm-training deep-learning transformer-xl cuda-programming artificial-intelligence
Created 2022-09-01
29 commits to main branch, last one 4 months ago
hirofumi0810
neural_sp hirofumi0810
141
596
apache-2.0
32
End-to-end ASR/LM implementation with PyTorch
asr ctc speech pytorch seq2seq attention streaming transformer language-model rnn-transducer transformer-xl language-modeling speech-recognition attention-mechanism sequence-to-sequence automatic-speech-recognition
Created 2017-09-10
3,218 commits to master branch, last one 3 years ago
MarcoMeter
episodic-transformer-memory-ppo MarcoMeter
18
152
mit
4
Clean baseline implementation of PPO using an episodic TransformerXL memory
ppo trxl gtrxl pomdp pytorch on-policy memory-gym transformer actor-critic transformer-xl episodic-memory policy-gradient gated-transformer-xl deep-reinforcement-learning proximal-policy-optimization
Created 2022-05-04
9 commits to main branch, last one 5 months ago
MarcoMeter
endless-memory-gym MarcoMeter
2
86
mit
5
Challenging Memory-based Deep Reinforcement Learning Agents
gru lstm trxl gtrxl pomdp benchmark recurrence transformer transformer-xl gym-environment imperfect-information deep-reinforcement-learning
Created 2022-07-05
105 commits to main branch, last one 26 days ago
asigalov61
SuperPiano asigalov61
14
80
apache-2.0
1
Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)
sota music piano xlnet fastai awesome reformer performer piano-colab transformers transformer-xl machine-learning music-generation music-composition music-transformer pytorch-implementation artificial-intelligence
Created 2020-06-05
119 commits to master branch, last one 3 years ago
CyberZHG
keras-transformer-xl CyberZHG
13
68
mit
6
Transformer-XL with checkpoint loader
keras transformer-xl
This repository has been archived (exclude archived)
Created 2019-06-20
34 commits to master branch, last one 2 years ago
augustwester
transformer-xl augustwester
3
35
mit
2
A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)
nlp xlnet pytorch transformer self-attention transformer-xl cross-attention
Created 2022-11-20
81 commits to main branch, last one about a year ago