1 result found Sort:

lucidrains
mixture-of-attention lucidrains
3
108
mit
8
Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
deep-learning routed-attention mixture-of-experts attention-mechanisms artificial-intelligence
Created 2023-04-21
42 commits to main branch, last one about a month ago