1 result found Sort:

lucidrains
mixture-of-attention lucidrains
3
100
mit
8
Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
deep-learning routed-attention mixture-of-experts attention-mechanisms artificial-intelligence
Created 2023-04-21
41 commits to main branch, last one 11 months ago