4 results found Sort:

koayon
awesome-adaptive-computation koayon
8
134
apache-2.0
4
A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
nlp pytorch tensorflow transformers computer-vision machine-learning mixture-of-experts adaptive-computation
Created 2023-08-17
137 commits to main branch, last one 18 days ago
LINs-lab
DynMoE LINs-lab
9
55
apache-2.0
11
[Preprint] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
moe language-model mixture-of-experts adaptive-computation multimodal-large-language-models
Created 2024-05-17
12 commits to main branch, last one 4 months ago
lucidrains
self-reasoning-tokens-pytorch lucidrains
4
53
mit
6
Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
transformers deep-learning attention-mechanism adaptive-computation artificial-intelligence
Created 2024-05-02
12 commits to main branch, last one 7 months ago
lucidrains
pause-transformer lucidrains
1
50
mit
4
Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount of time on any token
transformers deep-learning adaptive-computation attention-mechanisms artificial-intelligence
Created 2023-10-18
20 commits to main branch, last one about a year ago