3 results found Sort:

pjlab-sys4nlp
llama-moe pjlab-sys4nlp
47
895
apache-2.0
8
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
llm moe llama expert-partition mixture-of-experts continual-pre-training
Created 2023-07-24
212 commits to main branch, last one 5 months ago
GAIR-NLP
ProX GAIR-NLP
15
204
apache-2.0
6
Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
llm llama mistral continual data-quality pre-training data-centric-ai neural-symbolic continual-pre-training
Created 2024-09-09
8 commits to main branch, last one 2 months ago
RUC-GSAI
Llama-3-SynE RUC-GSAI
3
29
apache-2.0
3
Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 Llama-3 的科学推理和中文能力
chinese science reasoning large-language-model continual-pre-training
Created 2024-07-24
11 commits to main branch, last one 4 days ago