2 results found Sort:

DefTruth
CUDA-Learn-Notes DefTruth
152
1.4k
gpl-3.0
13
🎉 Modern CUDA Learn Notes with PyTorch: CUDA Cores, Tensor Cores, fp32/tf32, fp16/bf16, fp8/int8, flash_attn, rope, sgemm, hgemm, sgemv, warp/block reduce, elementwise, softmax, layernorm, rmsnorm.
cuda gemm gemv triton pytorch rmsnorm softmax layernorm elementwise warp-reduce block-reduce flash-attention cuda-programming flash-attention-2 flash-attention-3
Created 2022-12-17
299 commits to main branch, last one 2 days ago
bzhangGo
rmsnorm bzhangGo
12
212
bsd-3-clause
4
Root Mean Square Layer Normalization
rmsnorm layernorm
Created 2019-09-24
7 commits to master branch, last one about a year ago