Guitaricet / relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

Date Created 2023-04-27 (about a year ago)

Commits 217 (last one 11 months ago)

Stargazers 439 (0 this week)

Watchers 7 (0 this week)

Forks 39

License apache-2.0

Ranking

RepositoryStats indexes 595,856 repositories, of these Guitaricet/relora is ranked #100,920 (83rd percentile) for total stargazers, and #271,583 for total watchers. Github reports the primary language for this repository as Jupyter Notebook, for repositories using this language it is ranked #2,175/17,543.

Guitaricet/relora is also tagged with popular topics, for these it's ranked: deep-learning (#2,243/8512), nlp (#628/2430), transformer (#238/1018), llama (#188/547)

Other Information

Guitaricet/relora has 1 open pull request on Github, 0 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 4 open issues and 13 closed issues.

Homepage URL: https://arxiv.org/abs/2307.05695

All Topics

nlp peft llama transformer deep-learning distributed-training

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

217 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Jupyter Notebook but there's also others...

updated: 2024-12-16 @ 12:59pm, id: 633579562 / R_kgDOJcOoKg