2 results found Sort:

bzhangGo
rmsnorm bzhangGo
12
215
bsd-3-clause
4
Root Mean Square Layer Normalization
rmsnorm layernorm
Created 2019-09-24
7 commits to master branch, last one about a year ago
tech-srl
layer_norm_expressivity_role tech-srl
3
45
unknown
7
Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
attention layernorm transformers layer-normalization
Created 2023-05-03
4 commits to main branch, last one 2 months ago