4 results found Sort:

koayon
awesome-adaptive-computation koayon
8
137
apache-2.0
4
A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
nlp pytorch tensorflow transformers computer-vision machine-learning mixture-of-experts adaptive-computation
Created 2023-08-17
139 commits to main branch, last one 29 days ago
LINs-lab
DynMoE LINs-lab
9
63
apache-2.0
12
[ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
moe language-model mixture-of-experts adaptive-computation multimodal-large-language-models
Created 2024-05-17
17 commits to main branch, last one 6 days ago
lucidrains
self-reasoning-tokens-pytorch lucidrains
4
54
mit
6
Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
transformers deep-learning attention-mechanism adaptive-computation artificial-intelligence
Created 2024-05-02
12 commits to main branch, last one 8 months ago
lucidrains
pause-transformer lucidrains
1
52
mit
4
Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount of time on any token
transformers deep-learning adaptive-computation attention-mechanisms artificial-intelligence
Created 2023-10-18
20 commits to main branch, last one about a year ago