1 result found Sort:

lucidrains
ring-attention-pytorch lucidrains
22
397
mit
8
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
long-context attention-mechanism efficient-attention distributed-attention
Created 2024-02-14
196 commits to main branch, last one 2 months ago