66 results found Sort:

liguodongiot
llm-action liguodongiot
1.3k
12.0k
apache-2.0
99
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
llm llmops llm-serving llm-training llm-inference
Created 2023-05-23
901 commits to main branch, last one 4 days ago
ludwig-ai
ludwig ludwig-ai
1.2k
11.2k
apache-2.0
194
Low-code framework for building custom LLMs, neural networks, and other AI models
ml llm deep llama llama2 mistral pytorch learning fine-tuning data-centric data-science deeplearning llm-training deep-learning neural-network computer-vision machinelearning machine-learning natural-language natural-language-processing
Created 2018-12-27
3,861 commits to master branch, last one 2 months ago
skypilot-org
skypilot skypilot-org
531
6.9k
apache-2.0
70
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
gpu tpu finops job-queue multicloud llm-serving ml-platform data-science llm-training deep-learning job-scheduler spot-instances cloud-computing cost-management cloud-management machine-learning cost-optimization ml-infrastructure distributed-training hyperparameter-tuning
Created 2021-08-11
2,187 commits to master branch, last one 13 hours ago
InternLM
xtuner InternLM
322
4.1k
apache-2.0
36
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one about a month ago
h2oai
h2o-llmstudio h2oai
418
4.1k
apache-2.0
80
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
ai gpt llm llama llama2 chatbot chatgpt finetuning generative fine-tuning llm-training generative-ai
Created 2023-04-17
450 commits to main branch, last one about a month ago
linkedin
Liger-Kernel linkedin
230
3.9k
bsd-2-clause
40
Efficient Triton Kernels for LLM Training
llms phi3 llama gemma2 llama3 triton mistral finetuning llm-training triton-kernels
Created 2024-08-06
356 commits to main branch, last one a day ago
databricks
dbrx databricks
238
2.5k
other
41
Code examples and resources for DBRX, a large language model developed by Databricks
llm gen-ai mosaic-ai databricks llm-training generative-ai llm-inference
Created 2024-03-26
9 commits to main branch, last one 8 months ago
dstackai
dstack dstackai
161
1.6k
mpl-2.0
12
dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.
aws gcp gpu k8s llms azure cloud llmops python training kubernetes fine-tuning llm-training llm-inference orchestration machine-learning
Created 2022-01-04
2,359 commits to master branch, last one a day ago
intelligent-machine-learning
dlrover intelligent-machine-learning
168
1.3k
other
49
DLRover: An Automatic Distributed Deep Learning System
k8s llm-training hacktoberfest distributed-training
Created 2022-06-24
2,864 commits to master branch, last one 4 days ago
utkuozdemir
nvidia_gpu_exporter utkuozdemir
112
935
mit
11
Nvidia GPU exporter for prometheus using nvidia-smi binary
ai llm gaming nvidia monitoring nvidia-gpu nvidia-smi prometheus llm-training cryptocurrency prometheus-exporter
Created 2021-06-08
625 commits to master branch, last one 2 days ago
sail-sg
Adan sail-sg
64
771
apache-2.0
7
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
mae moe vit adan gpt2 llms timm resnet fairseq pytorch convnext diffusion optimizer bert-model dreamfusion llm-training deep-learning transformer-xl cuda-programming artificial-intelligence
Created 2022-09-01
29 commits to main branch, last one 5 months ago
volcengine
veScale volcengine
34
680
apache-2.0
34
A PyTorch Native LLM Training Framework
pytorch llm-training
Created 2024-02-26
36 commits to main branch, last one 3 months ago
ghimiresunil
LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing ghimiresunil
113
638
mit
17
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
bert huggingface open-source llm-training transformers llm-inference llm-tutorials open-source-llm large-language-models
Created 2023-05-28
668 commits to main branch, last one 14 days ago
anarchy-ai
LLM-VM anarchy-ai
144
483
mit
12
irresponsible innovation. Try now at https://chat.dev/
llm llm-agent llm-local distillation llm-training deep-learning llm-inference machine-learning distillation-model artificial-intelligence
Created 2023-05-19
503 commits to main branch, last one 7 months ago
rohan-paul
LLM-FineTuning-Large-Language-Models rohan-paul
114
478
unknown
9
LLM (Large Language Model) FineTuning
llm gpt-3 llama2 pytorch gpt3-turbo mistral-7b llm-serving llm-training llm-inference llm-finetuning open-source-llm large-language-models
Created 2023-10-22
165 commits to main branch, last one 7 months ago
mallorbc
Finetune_LLMs mallorbc
84
451
agpl-3.0
10
Repo for fine-tuning Casual LLMs
gpt llm mpt gpt-3 gpt-4 llama docker falcon llama2 gpt-j-6b gpt-35-turbo llm-training
Created 2021-08-07
166 commits to main branch, last one 8 months ago
FlagAI-Open
Aquila2 FlagAI-Open
30
439
unknown
5
The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
llm llm-training llm-inference
Created 2023-09-26
152 commits to main branch, last one 2 months ago
tigerlab-ai
tiger tigerlab-ai
26
390
apache-2.0
11
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
llm rag aisafety ai-safety fine-tuning llm-training classification data-augmentation large-language-models
Created 2023-10-23
137 commits to main branch, last one about a year ago
feifeibear
long-context-attention feifeibear
28
388
apache-2.0
5
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
pytorch llm-training llm-inference ring-attention deepspeed-ulysses attention-is-all-you-need
Created 2024-03-27
225 commits to main branch, last one 4 days ago
InternLM
InternEvo InternLM
54
317
apache-2.0
10
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism
Created 2024-01-16
493 commits to develop branch, last one 4 days ago
armbues
SiLLM armbues
23
234
mit
8
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
dpo llm mlx lora llm-training apple-silicon llm-inference large-language-models
Created 2024-01-11
485 commits to main branch, last one 2 days ago
promptslab
LLMtuner promptslab
15
232
apache-2.0
4
FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
llm llmops whisper finetune llmtuner finetuning fine-tuning finetune-gpt finetune-llm llm-training finetune-llms finetuning-rl llm-framework llm-inference finetune-llama fine-tuning-llm finetunechatgpt finetune-whisper whisper-finetune finetuning-large-language-models
Created 2023-04-28
79 commits to main branch, last one 11 months ago
aws-samples
awsome-distributed-training aws-samples
90
219
mit-0
12
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
aws efa eks gpu llm awsbatch hyperpod llm-training generative-ai parallelcluster
Created 2023-09-30
1,104 commits to main branch, last one 3 days ago
substratusai
runbooks substratusai
14
170
other
7
Finetune LLMs on K8s by using Runbooks
mlops llmops kubernetes llm-serving ml-platform llm-training llm-inference kubernetes-operator
This repository has been archived (exclude archived)
Created 2023-06-19
138 commits to main branch, last one 3 months ago
Laz4rz
GPT-2 Laz4rz
5
166
unknown
2
Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
llm gpt2 gpt-2 guidelines llm-training deep-learning machine-learning deep-learning-tutorial
Created 2024-06-19
91 commits to main branch, last one 4 months ago
openpsi-project
ReaLHF openpsi-project
8
153
apache-2.0
4
Super-Efficient RLHF Training of LLMs with Parameter Reallocation
llm deepspeed megatron-lm llm-training transformers llm-framework distributed-systems distributed-computing large-language-models reinforcement-learning large-scale-machine-learning reinforcement-learning-from-human-feedback
Created 2024-06-18
1,075 commits to main branch, last one 6 days ago
neo4j-labs
text2cypher neo4j-labs
18
150
cc0-1.0
5
collection of text2cypher datasets, evaluations, and finetuning instructions
llm llms graph neo4j cypher text2cypher llm-datasets llm-training cypher-query-language
Created 2024-02-05
27 commits to main branch, last one 6 months ago
yinizhilian
ICLR2024-Papers-with-Code yinizhilian
8
150
unknown
4
ICLR 2024 论文和开源项目合集
gpt llms llama3 python gemmini iclr2021 iclr2022 iclr2023 iclr2024 llm-agent transformer llm-training llm-framework llm-reasoning paperwithcode machine-learning deep-learning-paper nlp-machine-learning nlp-keywords-extraction
Created 2024-05-14
20 commits to main branch, last one 7 months ago
MatX-inc
seqax MatX-inc
10
136
bsd-3-clause
7
seqax = sequence modeling + JAX
llm-training
Created 2024-04-26
6 commits to main branch, last one 5 months ago
shivendrra
SmallLanguageModel shivendrra
16
128
mit
4
a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
gpt llms bert-model transformer llm-cookbook llm-training decoder-model neural-networks machine-learning
Created 2023-12-03
217 commits to main branch, last one 5 months ago