VITA-Group / Random-MoE-as-Dropout

[ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang

VITA-Group
VITA-Group
Date Created 2023-02-18 (2 years ago)
Commits 2 (last one 2 years ago)
Stargazers 48 (0 this week)
Watchers 2 (0 this week)
Forks 2
License apache-2.0
Ranking

RepositoryStats indexes 631,885 repositories, of these VITA-Group/Random-MoE-as-Dropout is ranked #502,843 (20th percentile) for total stargazers, and #481,103 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #98,323/128,927.

VITA-Group/Random-MoE-as-Dropout is also tagged with popular topics, for these it's ranked: transformer (#887/1074)

Other Information

VITA-Group/Random-MoE-as-Dropout has Github issues enabled, there are 4 open issues and 0 closed issues.

Star History

Github stargazers over time

5050454540403535303025252020151510105500Mar '23Mar '23May '23May '23Jul '23Jul '23Aug '23Aug '23Oct '23Oct '23Dec '23Dec '23Feb '24Feb '24Apr '24Apr '24Jun '24Jun '24Aug '24Aug '24Oct '24Oct '24Dec '24Dec '24Feb '25Feb '25

Watcher History

Github watchers over time, collection started in '23

33332222221111Dec '23Dec '2320242024Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Recent Commit History

2 commits on the default branch (main) since jan '22

22221111110000Mar '23Mar '23May '23May '23Jul '23Jul '23Aug '23Aug '23Oct '23Oct '23Dec '23Dec '23Feb '24Feb '24Apr '24Apr '24Jun '24Jun '24Aug '24Aug '24Oct '24Oct '24Dec '24Dec '24Feb '25Feb '25

Yearly Commits

Commits to the default branch (main) per year

2222111111000020242024

Issue History

Total Issues
Open Issues
Closed Issues
443.53.5332.52.5221.51.5110.50.500Apr '23Apr '23Jun '23Jun '23Aug '23Aug '23Oct '23Oct '23Dec '23Dec '23Feb '24Feb '24Apr '24Apr '24Jun '24Jun '24Aug '24Aug '24Oct '24Oct '24Dec '24Dec '24Feb '25Feb '25

Languages

The primary language is Python but there's also others...

PythonPythonShellShell

updated: 2025-01-08 @ 12:28am, id: 603566767 / R_kgDOI_myrw