5 results found Sort:

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Created 2022-06-12
522 commits to main branch, last one 2 months ago
52
303
apache-2.0
10
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
Created 2024-01-16
478 commits to develop branch, last one 8 days ago
15
296
apache-2.0
11
Slicing a PyTorch Tensor Into Parallel Shards
Created 2021-04-27
9 commits to main branch, last one 3 years ago
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
Created 2023-06-14
554 commits to main branch, last one 10 months ago
JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
Created 2024-03-14
45 commits to master branch, last one 6 months ago