5 results found Sort:
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Created
2022-06-12
522 commits to main branch, last one 2 months ago
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
Created
2024-01-16
478 commits to develop branch, last one 8 days ago
Slicing a PyTorch Tensor Into Parallel Shards
Created
2021-04-27
9 commits to main branch, last one 3 years ago
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
Created
2023-06-14
554 commits to main branch, last one 10 months ago
JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
Created
2024-03-14
45 commits to master branch, last one 6 months ago