1 result found Sort:

VITA-Group
Random-MoE-as-Dropout VITA-Group
2
43
apache-2.0
2
[ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang
moe dropout transformer self-slimmable
Created 2023-02-18
2 commits to main branch, last one about a year ago