1 result found Sort:

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
Created 2023-04-21
42 commits to main branch, last one 2 months ago