2 results found Sort:

VPGTrans
VPGTrans VPGTrans
25
269
bsd-3-clause
6
Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.
llm vl-llm vision-language-model large-scale-language-modeling
Created 2023-04-30
24 commits to main branch, last one about a year ago
xrsrke
pipegoose xrsrke
18
80
mit
4
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
moe zero-1 megatron megatron-lm transformers 3d-parallelism data-parallelism model-parallelism mixture-of-experts tensor-parallelism pipeline-parallelism sequence-parallelism distributed-optimizers huggingface-transformers large-scale-language-modeling
Created 2023-06-14
554 commits to main branch, last one 10 months ago