12 results found Sort:
- Filter by Primary Language:
- Python (9)
- C++ (1)
- Jupyter Notebook (1)
- +
Making large AI models cheaper, faster and more accessible
Created
2021-10-28
3,357 commits to main branch, last one 21 hours ago
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Created
2020-01-23
2,316 commits to master branch, last one 11 hours ago
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Created
2022-06-12
508 commits to main branch, last one about a month ago
飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
Created
2018-12-12
440 commits to develop branch, last one 9 months ago
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
Created
2021-10-25
348 commits to main branch, last one about a month ago
Personal Project: MPP-Qwen14B(Multimodal Pipeline Parallel-Qwen14B). Don't let the poverty limit your imagination! Train your own 14B LLaVA-like MLLM on RTX3090/4090 24GB.
Created
2023-10-24
85 commits to master branch, last one a day ago
Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
Created
2022-02-23
21 commits to main branch, last one about a year ago
A curated list of awesome projects and papers for distributed training or inference
Created
2022-04-22
29 commits to main branch, last one 2 months ago
An Alternative for Triton Inference Server. Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Bac...
Created
2023-10-24
140 commits to main branch, last one 9 days ago
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
Created
2023-06-14
554 commits to main branch, last one 5 months ago
FTPipe and related pipeline model parallelism research.
Created
2020-06-29
2,372 commits to master branch, last one about a year ago
Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.
Created
2021-05-30
16 commits to main branch, last one 5 months ago