davidmrau / mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

Date Created 2019-07-19 (5 years ago)

Commits 30 (last one 7 months ago)

Stargazers 984 (3 this week)

Watchers 5 (0 this week)

Forks 104

License gpl-3.0

Ranking

RepositoryStats indexes 585,880 repositories, of these davidmrau/mixture-of-experts is ranked #51,472 (91st percentile) for total stargazers, and #332,676 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #8,029/116,710.

davidmrau/mixture-of-experts is also tagged with popular topics, for these it's ranked: pytorch (#821/5958)

Other Information

davidmrau/mixture-of-experts has Github issues enabled, there are 5 open issues and 21 closed issues.

All Topics

moe pytorch re-implementation mixture-of-experts sparsely-gated-mixture-of-experts

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

13 commits on the default branch (master) since jan '22

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The only known language in this repository is Python

updated: 2024-11-21 @ 08:01pm, id: 197785701 / R_kgDOC8n4ZQ