3 results found Sort:

eyaadh
megadlbot_oss eyaadh
165
183
unknown
10
Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started...
bot seedr ffmpeg aiohttp ffprobe mongodb pymongo aiofiles megatron pyrogram telegram tgcrypto megadlbot youtube-dl google-python-api
Created 2020-09-09
210 commits to master branch, last one 3 years ago
xrsrke
pipegoose xrsrke
18
81
mit
3
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
moe zero-1 megatron megatron-lm transformers 3d-parallelism data-parallelism model-parallelism mixture-of-experts tensor-parallelism pipeline-parallelism sequence-parallelism distributed-optimizers huggingface-transformers large-scale-language-modeling
Created 2023-06-14
554 commits to main branch, last one about a year ago
MoFHeka
LLaMA-Megatron MoFHeka
2
28
apache-2.0
1
A LLaMA1/LLaMA12 Megatron implement.
llm llama llama2 pytorch megatron megatron-lm llm-training
Created 2023-06-26
10 commits to main branch, last one about a year ago