1 result found Sort:

dingo-actual
infini-transformer dingo-actual
20
245
mit
6
PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)
pytorch long-context transformers deep-learning infini-attention mixture-of-depths attention-mechanism
Created 2024-04-15
81 commits to main branch, last one about a month ago