Search Results - RepositoryStats

876

12.8k

apache-2.0

132

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...

gpt rnn lstm rwkv gpt-2 gpt-3 chatgpt pytorch transformer transformers deep-learning language-model linear-attention attention-mechanism

Created 2021-08-08

682 commits to main branch, last one a day ago

LION happinesslz

10

142

apache-2.0

2

[NeurIPS 2024] Official code of ”LION: Linear Group RNN for 3D Object Detection in Point Clouds“

linear-rnn linear-attention 3d-object-detection

Created 2024-07-24

48 commits to main branch, last one 2 months ago

taylor-series-linear-attention lucidrains

3

90

mit

2

Explorations into the recently proposed Taylor Series Linear Attention

deep-learning linear-attention attention-mechanisms artificial-intelligence

Created 2023-12-23

35 commits to main branch, last one 4 months ago

agent-attention-pytorch lucidrains

4

87

mit

3

Implementation of Agent Attention in Pytorch

deep-learning linear-attention attention-mechanisms artificial-intelligence

Created 2023-12-18

20 commits to main branch, last one 5 months ago

Multi-Attention-Network lironui

7

75

agpl-3.0

4

The semantic segmentation of remote sensing images

segmentation remote-sensing linear-attention attention-mechanism semantic-segmentation

Created 2020-08-25

36 commits to master branch, last one 2 years ago

MAResU-Net lironui

2

45

agpl-3.0

3

The semantic segmentation of remote sensing images

attention segmentation remote-sensing linear-attention attention-mechanism semantic-segmentation

Created 2020-11-28

18 commits to main branch, last one 2 years ago

autoregressive-linear-attention-cuda lucidrains

3

43

mit

4

CUDA implementation of autoregressive linear attention, with all the latest research findings

cuda deep-learning linear-attention attention-mechanisms artificial-intelligence

Created 2023-02-07

4 commits to main branch, last one about a year ago