1 result found Sort:

InternLM
InternEvo InternLM
47
285
apache-2.0
9
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism
Created 2024-01-16
473 commits to develop branch, last one 3 days ago