2 results found Sort:

cliang1453
SAGE cliang1453
2
30
mit
1
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)
pruning redundancy fine-tuning transformers generalization adaptive-learning-rate
Created 2022-02-04
4 commits to main branch, last one 3 years ago
EnnengYang
AdaTask EnnengYang
1
27
unknown
1
AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task Learning. AAAI, 2023.
negative-transfer multi-task-learning adaptive-learning-rate multi-objective-optimization
Created 2023-03-24
5 commits to master branch, last one about a year ago