6 results found Sort:

BlinkDL
RWKV-LM BlinkDL
812
11.8k
apache-2.0
136
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...
gpt rnn lstm rwkv gpt-2 gpt-3 chatgpt pytorch transformer transformers deep-learning language-model linear-attention attention-mechanism
Created 2021-08-08
614 commits to main branch, last one 20 hours ago
lucidrains
taylor-series-linear-attention lucidrains
2
80
mit
2
Explorations into the recently proposed Taylor Series Linear Attention
deep-learning linear-attention attention-mechanisms artificial-intelligence
Created 2023-12-23
33 commits to main branch, last one 4 months ago
lucidrains
agent-attention-pytorch lucidrains
1
74
mit
3
Implementation of Agent Attention in Pytorch
deep-learning linear-attention attention-mechanisms artificial-intelligence
Created 2023-12-18
19 commits to main branch, last one 5 months ago
lironui
Multi-Attention-Network lironui
7
58
agpl-3.0
4
The semantic segmentation of remote sensing images
segmentation remote-sensing linear-attention attention-mechanism semantic-segmentation
Created 2020-08-25
36 commits to master branch, last one about a year ago
lucidrains
autoregressive-linear-attention-cuda lucidrains
3
45
mit
4
CUDA implementation of autoregressive linear attention, with all the latest research findings
cuda deep-learning linear-attention attention-mechanisms artificial-intelligence
Created 2023-02-07
4 commits to main branch, last one about a year ago
lironui
MAResU-Net lironui
2
41
agpl-3.0
3
The semantic segmentation of remote sensing images
attention segmentation remote-sensing linear-attention attention-mechanism semantic-segmentation
Created 2020-11-28
18 commits to main branch, last one about a year ago