1 result found Sort:

kyegomez
SwitchTransformers kyegomez
9
55
mit
3
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
ai ml moe gpt4 llama multi-modal mixture-model mixture-of-models mixture-of-experts
Created 2024-01-22
11 commits to main branch, last one 10 months ago