Search Results - RepositoryStats

attention-is-all-you-need-pytorch jadore801120

2.0k

8.8k

mit

97

A PyTorch implementation of the Transformer model in "Attention is All You Need".

nlp pytorch attention deep-learning attention-is-all-you-need natural-language-processing

Created 2017-06-14

196 commits to master branch, last one 3 years ago

transformer Kyubyong

1.3k

4.3k

apache-2.0

110

A TensorFlow Implementation of the Transformer: Attention Is All You Need

transformer translation implementation attention-mechanism attention-is-all-you-need

Created 2017-06-17

37 commits to master branch, last one 5 years ago

whisper-timestamped linto-ai

156

2.0k

agpl-3.0

29

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

Created 2023-01-13

248 commits to master branch, last one 2 days ago

sockeye awslabs

323

1.2k

apache-2.0

50

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

pytorch seq2seq sockeye transformer translation deep-learning attention-model encoder-decoder machine-learning attention-mechanism machine-translation transformer-network deep-neural-networks sequence-to-sequence transformer-architecture attention-is-all-you-need neural-machine-translation sequence-to-sequence-models

Created 2017-06-08

836 commits to main branch, last one 13 days ago

awesome-fast-attention Separius

108

989

gpl-3.0

32

list of efficient attention modules

awesome reformer attention linformer longformer transformer self-attention multihead-attention transformer-network attention-is-all-you-need

This repository has been archived (exclude archived)

Created 2020-07-31

46 commits to master branch, last one 3 years ago

bert_language_understanding brightmart

211

958

unknown

49

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp textcnn fasttext bert-model pre-training language-model self-attention transfer-learning question-answering text-classification transformer-encoder language-understanding document-classification attention-is-all-you-need

Created 2018-10-23

101 commits to master branch, last one 5 years ago

Speech-Transformer kaituoxu

196

769

unknown

30

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr pytorch attention end-to-end transformer self-attention attention-is-all-you-need

Created 2018-11-22

23 commits to master branch, last one about a year ago

attention-is-all-you-need-keras lsdefine

188

708

unknown

26

A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need

keras deep-learning keras-tensorflow attention-seq2seq attention-is-all-you-need

Created 2018-03-16

29 commits to master branch, last one 3 years ago

LongNet kyegomez

64

685

apache-2.0

18

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

gpt3 gpt4 chatgpt attention transformer context-length machine-learning attention-mechanisms artificial-intelligence attention-is-all-you-need

Created 2023-07-06

181 commits to master branch, last one 10 months ago

pytorch-transformer hkproj

255

606

unknown

11

Attention is all you need implementation

pytorch transformer paper-implementations attention-is-all-you-need

Created 2023-05-18

53 commits to main branch, last one 11 months ago

kospeech sooftware

191

604

apache-2.0

20

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

asr las jasper e2e-asr pytorch seq2seq conformer end-to-end las-models ksponspeech transformer korean-speech speech-recognition attention-is-all-you-need

Created 2019-10-30

2,212 commits to latest branch, last one about a year ago

TextClassificationBenchmark FreedomIntelligence

138

601

mit

32

A Benchmark of Text Classification in PyTorch

cnn crnn lstm rcnn capusle pytorch quantum benchmark cnn-classification text-classification lstm-sentiment-analysis attention-is-all-you-need

Created 2017-12-13

205 commits to master branch, last one 6 months ago

nmt-keras lvapeab

130

533

mit

26

Neural Machine Translation with Keras

gru nmt keras theano web-demo tensorflow transformer deep-learning lstm-networks attention-model machine-learning attention-seq2seq attention-mechanism machine-translation sequence-to-sequence attention-is-all-you-need neural-machine-translation

Created 2016-11-22

681 commits to master branch, last one 3 years ago

CM3Leon kyegomez

18

362

mit

22

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images

dalle attention multimodal multimodality imagegeneration multimodal-learning attention-is-all-you-need

Created 2023-07-14

73 commits to main branch, last one 10 months ago

long-context-attention feifeibear

24

349

apache-2.0

4

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

pytorch llm-training llm-inference ring-attention deepspeed-ulysses attention-is-all-you-need

Created 2024-03-27

198 commits to main branch, last one 21 days ago

ScreenAI kyegomez

28

286

mit

9

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

ai ml gpt-4 pytorch attention tensorflow machine-learning artificial-intelligence attention-is-all-you-need

Created 2024-02-08

20 commits to main branch, last one 8 months ago

InfEdit sled-group

8

285

other

5

[CVPR 2024] Official implementation of CVPR 2024 paper: "Inversion-Free Image Editing with Natural Language"

inversion image-edit diffusion-models prompt-to-prompt consistency-models attention-is-all-you-need

Created 2023-12-04

27 commits to main branch, last one 5 months ago

PALM-E kyegomez

42

270

apache-2.0

5

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

gpt4 multimodal deeplearning deep-learning attention-mechanism artificial-intelligence attention-is-all-you-need artificial-neural-networks

Created 2023-06-09

190 commits to main branch, last one 9 months ago

a-PyTorch-Tutorial-to-Transformers sgrvinod

44

255

mit

7

Attention Is All You Need | a PyTorch Tutorial to Transformers

pytorch transformer pytorch-tutorial transformer-tutorial transformer-architecture attention-is-all-you-need

Created 2020-01-30

19 commits to master branch, last one 11 months ago

pytorch-transformer leviswind

58

239

unknown

3

pytorch implementation of Attention is all you need

pytorch transformer translation attention-is-all-you-need

Created 2018-01-05

8 commits to master branch, last one 6 years ago

attention-is-all-you-need-paper brandokoch

46

231

mit

3

Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.

pytorch transformer deep-learning machine-learning attention-is-all-you-need

Created 2021-12-02

15 commits to master branch, last one about a year ago

transformer-from-scratch-notes hkproj

47

218

unknown

3

Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)

notes study-notes transformer attention-model transformer-architecture attention-is-all-you-need

Created 2023-05-25

6 commits to main branch, last one about a year ago

RT-X kyegomez

19

169

mit

8

Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"

gpt4 vision gpt4all multimodal attention-model computer-vision vision-transformer artificial-intelligence attention-is-all-you-need

Created 2023-10-04

119 commits to main branch, last one 7 months ago

MambaTransformer kyegomez

17

165

mit

4

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

ai ssm gpt4 rnns zeta pytorch language multimodal tensorflow neural-network neural-networks machine-learning attention-mechanisms artificial-intelligence attention-is-all-you-need recurrent-neural-networks

Created 2024-01-13

21 commits to main branch, last one 7 months ago