rasbt / pytorch-memory-optim

This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.

Date Created 2023-06-27 (about a year ago)

Commits 11 (last one 11 months ago)

Stargazers 83 (0 this week)

Watchers 4 (0 this week)

Forks 10

License apache-2.0

Ranking

RepositoryStats indexes 534,880 repositories, of these rasbt/pytorch-memory-optim is ranked #308,219 (42nd percentile) for total stargazers, and #354,941 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #56,125/103,597.

rasbt/pytorch-memory-optim is also tagged with popular topics, for these it's ranked: deep-learning (#5,210/7826), pytorch (#3,672/5590), llm (#1,267/2049)

Other Information

Homepage URL: https://lightning.ai/pages/community/tutorial/pytorch-memory-vit-llm/

All Topics

llm vit vision pytorch deep-learning memory-optimization

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

11 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The only known language in this repository is Python

updated: 2024-06-10 @ 12:52am, id: 659388576 / R_kgDOJ014oA