Search Results - RepositoryStats

538

2.8k

mit

146

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

cnn rnn lstm audio paper phonemes end-to-end evaluation tensorflow deep-learning timit-dataset feature-vector data-preprocessing speech-recognition layer-normalization rnn-encoder-decoder chinese-speech-recognition automatic-speech-recognition

Created 2016-11-13

266 commits to master branch, last one 3 years ago

BabyGPT-Build_GPT_From_Scratch TatevKaren

16

49

unknown

4

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

gpt llms gpt-3 python pytorch llm-training transformers dropout-layers neural-networks layer-normalization residual-connections large-language-models attention-is-all-you-need multi-head-self-attention

Created 2023-12-01

69 commits to main branch, last one 9 months ago

layer_norm_expressivity_role tech-srl

3

43

unknown

7

Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)

attention layernorm transformers layer-normalization

Created 2023-05-03

4 commits to main branch, last one 2 days ago