2 results found Sort:

lucidrains
Mega-pytorch lucidrains
10
203
mit
8
Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
deep-learning long-range-arena attention-mechanisms artificial-intelligence exponential-moving-average
Created 2022-09-23
26 commits to main branch, last one about a year ago
FutureComputing4AI
Hrrformer FutureComputing4AI
5
47
unknown
3
Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)
hrr lra icml ember malware hrrformer icml-2023 transformer neuro-symbolic self-attention long-range-arena holographic-reduced-representations
Created 2023-05-09
10 commits to main branch, last one about a year ago