2 results found Sort:

dingo-actual
infini-transformer dingo-actual
23
286
mit
6
PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)
pytorch long-context transformers deep-learning infini-attention mixture-of-depths attention-mechanism
Created 2024-04-15
81 commits to main branch, last one 7 months ago
vmarinowski
infini-attention vmarinowski
7
41
unknown
1
An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'
python transformer transformers self-attention infini-attention machine-learning artificial-intelligence
Created 2024-04-20
23 commits to main branch, last one 4 months ago