1 result found Sort:

pjlab-sys4nlp
llama-moe pjlab-sys4nlp
46
883
apache-2.0
8
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
llm moe llama expert-partition mixture-of-experts continual-pre-training
Created 2023-07-24
212 commits to main branch, last one 4 months ago