Search Results - RepositoryStats

attention-is-all-you-need-pytorch jadore801120

1.9k

8.5k

mit

94

A PyTorch implementation of the Transformer model in "Attention is All You Need".

nlp pytorch attention deep-learning attention-is-all-you-need natural-language-processing

Created 2017-06-14

196 commits to master branch, last one 3 years ago

transformer Kyubyong

1.3k

4.2k

apache-2.0

110

A TensorFlow Implementation of the Transformer: Attention Is All You Need

transformer translation implementation attention-mechanism attention-is-all-you-need

Created 2017-06-17

37 commits to master branch, last one 4 years ago

whisper-timestamped linto-ai

134

1.6k

agpl-3.0

24

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

Created 2023-01-13

241 commits to master branch, last one about a month ago

sockeye awslabs

327

1.2k

apache-2.0

51

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

pytorch seq2seq sockeye transformer translation deep-learning attention-model encoder-decoder machine-learning attention-mechanism machine-translation transformer-network deep-neural-networks sequence-to-sequence transformer-architecture attention-is-all-you-need neural-machine-translation sequence-to-sequence-models

Created 2017-06-08

834 commits to main branch, last one 9 days ago

awesome-fast-attention Separius

108

980

gpl-3.0

32

list of efficient attention modules

awesome reformer attention linformer longformer transformer self-attention multihead-attention transformer-network attention-is-all-you-need

This repository has been archived (exclude archived)

Created 2020-07-31

46 commits to master branch, last one 2 years ago

bert_language_understanding brightmart

211

959

unknown

49

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need

Created 2018-10-23

101 commits to master branch, last one 5 years ago

Speech-Transformer kaituoxu

194

766

unknown

30

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr pytorch attention end-to-end transformer self-attention attention-is-all-you-need

Created 2018-11-22

23 commits to master branch, last one about a year ago

attention-is-all-you-need-keras lsdefine

192

703

unknown

26

A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need

keras deep-learning keras-tensorflow attention-seq2seq attention-is-all-you-need

Created 2018-03-16

29 commits to master branch, last one 2 years ago

LongNet kyegomez

62

655

apache-2.0

18

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

gpt3 gpt4 chatgpt attention transformer context-length machine-learning attention-mechanisms artificial-intelligence attention-is-all-you-need

Created 2023-07-06

181 commits to master branch, last one 4 months ago

TextClassificationBenchmark FreedomIntelligence

137

594

mit

32

A Benchmark of Text Classification in PyTorch

cnn crnn lstm rcnn capusle pytorch quantum benchmark cnn-classification text-classification lstm-sentiment-analysis attention-is-all-you-need

Created 2017-12-13

205 commits to master branch, last one about a month ago

kospeech sooftware

193

580

apache-2.0

19

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

asr las jasper e2e-asr pytorch seq2seq conformer end-to-end las-models ksponspeech transformer korean-speech speech-recognition attention-is-all-you-need

Created 2019-10-30

2,212 commits to latest branch, last one about a year ago

nmt-keras lvapeab

129

533

mit

26

Neural Machine Translation with Keras

gru nmt keras theano web-demo tensorflow transformer deep-learning lstm-networks attention-model machine-learning attention-seq2seq attention-mechanism machine-translation sequence-to-sequence attention-is-all-you-need neural-machine-translation

Created 2016-11-22

681 commits to master branch, last one 2 years ago

pytorch-transformer hkproj

184

414

unknown

10

Attention is all you need implementation

pytorch transformer paper-implementations attention-is-all-you-need

Created 2023-05-18

53 commits to main branch, last one 5 months ago

CM3Leon kyegomez

17

336

mit

21

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images

dalle attention multimodal multimodality imagegeneration multimodal-learning attention-is-all-you-need

Created 2023-07-14

73 commits to main branch, last one 5 months ago

pytorch-transformer leviswind

58

238

unknown

3

pytorch implementation of Attention is all you need

pytorch transformer translation attention-is-all-you-need

Created 2018-01-05

8 commits to master branch, last one 6 years ago

attention-is-all-you-need-paper brandokoch

46

222

mit

3

Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

pytorch transformer deep-learning machine-learning attention-is-all-you-need

Created 2021-12-02

15 commits to master branch, last one about a year ago

PALM-E kyegomez

38

219

apache-2.0

3

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

gpt4 multimodal deeplearning deep-learning attention-mechanism artificial-intelligence attention-is-all-you-need artificial-neural-networks

Created 2023-06-09

190 commits to main branch, last one 4 months ago

ScreenAI kyegomez

22

215

mit

7

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

ai ml gpt-4 pytorch attention tensorflow machine-learning artificial-intelligence attention-is-all-you-need

Created 2024-02-08

20 commits to main branch, last one 3 months ago

InfEdit sled-group

6

208

other

6

[CVPR 2024] Official implementation of CVPR 2024 paper: "Inversion-Free Image Editing with Natural Language"

inversion image-edit diffusion-models prompt-to-prompt consistency-models attention-is-all-you-need

Created 2023-12-04

27 commits to main branch, last one 3 days ago

a-PyTorch-Tutorial-to-Transformers sgrvinod

33

181

mit

6

Attention Is All You Need | a PyTorch Tutorial to Transformers

pytorch transformer pytorch-tutorial transformer-tutorial transformer-architecture attention-is-all-you-need

Created 2020-01-30

19 commits to master branch, last one 5 months ago

transformer-from-scratch-notes hkproj

39

162

unknown

3

Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)

notes study-notes transformer attention-model transformer-architecture attention-is-all-you-need

Created 2023-05-25

6 commits to main branch, last one about a year ago

long-context-attention feifeibear

7

159

unknown

4

Sequence Parallel Attention for Long Context LLM Model Training and Inference

pytorch llm-training llm-inference ring-attention deepspeed-ulysses attention-is-all-you-need

Created 2024-03-27

168 commits to main branch, last one 3 days ago

CrowdNav_Prediction_AttnGraph Shuijing725

25

133

mit

3

[ICRA 2023] Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graph

deep-learning crowd-navigation collision-avoidance trajectory-prediction reinforcement-learning human-robot-interaction attention-is-all-you-need deep-reinforcement-learning

Created 2023-01-03

17 commits to main branch, last one about a month ago

transformers_without_tears tnq177

17

128

mit

8

Transformers without Tears: Improving the Normalization of Self-Attention

pytorch transformer machine-translation attention-is-all-you-need

Created 2019-10-15

17 commits to master branch, last one 2 days ago

MambaTransformer kyegomez

11

127

mit

4

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

ai ssm gpt4 rnns zeta pytorch language multimodal tensorflow neural-network neural-networks machine-learning attention-mechanisms artificial-intelligence attention-is-all-you-need recurrent-neural-networks

Created 2024-01-13

21 commits to main branch, last one 2 months ago

RT-X kyegomez

13

122

mit

8

Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"

gpt4 vision gpt4all multimodal attention-model computer-vision vision-transformer artificial-intelligence attention-is-all-you-need

Created 2023-10-04

119 commits to main branch, last one 2 months ago

NJUNMT-pytorch whr94621

31

94

mit

13

This repository has no description...

nmt pytorch attention-is-all-you-need neural-machine-translation

Created 2018-03-31

167 commits to master branch, last one 5 years ago

LongRoPE jshuadvd

8

82

unknown

5

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

ai gpt llm nlp natural tokenizers tokenization transformers deep-learning language-model machine-learning attention-mechanisms artificial-intelligence transformer-architecture attention-is-all-you-need natural-language-inference natural-language-processing natural-language-procressing natural-language-understanding

Created 2024-03-06

79 commits to master branch, last one 3 days ago

Jamba kyegomez

3

77

mit

6

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

ai ml gpt ssm transformers attention-mechanism attention-mechanisms attention-is-all-you-need artificial-neural-networks

Created 2024-04-01

10 commits to main branch, last one 2 months ago

Deep-Learning-Based-Radio-Signal-Classification alexivaner

21

74

mit

3

Final Project for AI Wireless

radio resnet signal classification neural-network signal-processing attention-is-all-you-need

Created 2020-12-04

83 commits to main branch, last one 2 years ago