2 results found Sort:

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
Created 2024-03-27
198 commits to main branch, last one 21 days ago
52
303
apache-2.0
10
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
Created 2024-01-16
478 commits to develop branch, last one 8 days ago