Search Results - RepositoryStats

567

6.6k

apache-2.0

33

Use PEFT or Full-parameter to finetune 500+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, Baichuan2, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Llama3.2-Visio...

llm rft sft grpo lora peft liger llama deploy distill open-r1 qwen2-5 internvl llama3-3 megatron qwen2-vl embedding multimodal deepseek-r1

Created 2023-08-01

1,686 commits to main branch, last one 12 hours ago

megadlbot_oss eyaadh

165

185

unknown

10

Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started...

bot seedr ffmpeg aiohttp ffprobe mongodb pymongo aiofiles megatron pyrogram telegram tgcrypto megadlbot youtube-dl google-python-api

Created 2020-09-09

210 commits to master branch, last one 3 years ago

pipegoose xrsrke

18

81

mit

3

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

moe zero-1 megatron megatron-lm transformers 3d-parallelism data-parallelism model-parallelism mixture-of-experts tensor-parallelism pipeline-parallelism sequence-parallelism distributed-optimizers huggingface-transformers large-scale-language-modeling

Created 2023-06-14

554 commits to main branch, last one about a year ago

LLaMA-Megatron MoFHeka

2

28

apache-2.0

1

A LLaMA1/LLaMA12 Megatron implement.

llm llama llama2 pytorch megatron megatron-lm llm-training

Created 2023-06-26

10 commits to main branch, last one about a year ago