64 results found Sort:

ludwig-ai
ludwig ludwig-ai
1.2k
11.2k
apache-2.0
194
Low-code framework for building custom LLMs, neural networks, and other AI models
ml llm deep llama llama2 mistral pytorch learning fine-tuning data-centric data-science deeplearning llm-training deep-learning neural-network computer-vision machinelearning machine-learning natural-language natural-language-processing
Created 2018-12-27
3,861 commits to master branch, last one about a month ago
liguodongiot
llm-action liguodongiot
1.1k
10.8k
apache-2.0
95
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
llm llmops llm-serving llm-training llm-inference
Created 2023-05-23
898 commits to main branch, last one 17 days ago
skypilot-org
skypilot skypilot-org
513
6.8k
apache-2.0
70
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
gpu tpu finops job-queue multicloud llm-serving ml-platform data-science llm-training deep-learning job-scheduler spot-instances cloud-computing cost-management cloud-management machine-learning cost-optimization ml-infrastructure distributed-training hyperparameter-tuning
Created 2021-08-11
2,135 commits to master branch, last one a day ago
h2oai
h2o-llmstudio h2oai
418
4.0k
apache-2.0
81
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
ai gpt llm llama llama2 chatbot chatgpt finetuning generative fine-tuning llm-training generative-ai
Created 2023-04-17
450 commits to main branch, last one 29 days ago
InternLM
xtuner InternLM
311
4.0k
apache-2.0
34
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one 13 days ago
linkedin
Liger-Kernel linkedin
206
3.5k
bsd-2-clause
40
Efficient Triton Kernels for LLM Training
llms phi3 llama gemma2 llama3 triton mistral finetuning llm-training triton-kernels
Created 2024-08-06
299 commits to main branch, last one a day ago
databricks
dbrx databricks
237
2.5k
other
41
Code examples and resources for DBRX, a large language model developed by Databricks
llm gen-ai mosaic-ai databricks llm-training generative-ai llm-inference
Created 2024-03-26
9 commits to main branch, last one 7 months ago
dstackai
dstack dstackai
153
1.6k
mpl-2.0
11
dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.
aws gcp gpu k8s llms azure cloud llmops python training kubernetes fine-tuning llm-training llm-inference orchestration machine-learning
Created 2022-01-04
2,285 commits to master branch, last one 20 hours ago
intelligent-machine-learning
dlrover intelligent-machine-learning
167
1.3k
other
50
DLRover: An Automatic Distributed Deep Learning System
k8s llm-training hacktoberfest distributed-training
Created 2022-06-24
2,824 commits to master branch, last one a day ago
utkuozdemir
nvidia_gpu_exporter utkuozdemir
106
899
mit
11
Nvidia GPU exporter for prometheus using nvidia-smi binary
ai llm gaming nvidia monitoring nvidia-gpu nvidia-smi prometheus llm-training cryptocurrency prometheus-exporter
Created 2021-06-08
613 commits to master branch, last one a day ago
sail-sg
Adan sail-sg
64
761
apache-2.0
7
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
mae moe vit adan gpt2 llms timm resnet fairseq pytorch convnext diffusion optimizer bert-model dreamfusion llm-training deep-learning transformer-xl cuda-programming artificial-intelligence
Created 2022-09-01
29 commits to main branch, last one 4 months ago
volcengine
veScale volcengine
34
669
apache-2.0
34
A PyTorch Native LLM Training Framework
pytorch llm-training
Created 2024-02-26
36 commits to main branch, last one 2 months ago
ghimiresunil
LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing ghimiresunil
112
631
mit
17
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
bert huggingface open-source llm-training transformers llm-inference llm-tutorials open-source-llm large-language-models
Created 2023-05-28
667 commits to main branch, last one 2 days ago
anarchy-ai
LLM-VM anarchy-ai
145
482
mit
12
irresponsible innovation. Try now at https://chat.dev/
llm llm-agent llm-local distillation llm-training deep-learning llm-inference machine-learning distillation-model artificial-intelligence
Created 2023-05-19
503 commits to main branch, last one 6 months ago
rohan-paul
LLM-FineTuning-Large-Language-Models rohan-paul
111
468
unknown
9
LLM (Large Language Model) FineTuning
llm gpt-3 llama2 pytorch gpt3-turbo mistral-7b llm-serving llm-training llm-inference llm-finetuning open-source-llm large-language-models
Created 2023-10-22
165 commits to main branch, last one 6 months ago
mallorbc
Finetune_LLMs mallorbc
84
449
agpl-3.0
10
Repo for fine-tuning Casual LLMs
gpt llm mpt gpt-3 gpt-4 llama docker falcon llama2 gpt-j-6b gpt-35-turbo llm-training
Created 2021-08-07
166 commits to main branch, last one 7 months ago
FlagAI-Open
Aquila2 FlagAI-Open
30
438
unknown
5
The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
llm llm-training llm-inference
Created 2023-09-26
152 commits to main branch, last one about a month ago
tigerlab-ai
tiger tigerlab-ai
26
390
apache-2.0
11
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
llm rag aisafety ai-safety fine-tuning llm-training classification data-augmentation large-language-models
Created 2023-10-23
137 commits to main branch, last one 11 months ago
feifeibear
long-context-attention feifeibear
24
362
apache-2.0
4
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
pytorch llm-training llm-inference ring-attention deepspeed-ulysses attention-is-all-you-need
Created 2024-03-27
214 commits to main branch, last one 2 days ago
InternLM
InternEvo InternLM
52
310
apache-2.0
10
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism
Created 2024-01-16
479 commits to develop branch, last one 3 days ago
promptslab
LLMtuner promptslab
15
232
apache-2.0
4
FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
llm llmops whisper finetune llmtuner finetuning fine-tuning finetune-gpt finetune-llm llm-training finetune-llms finetuning-rl llm-framework llm-inference finetune-llama fine-tuning-llm finetunechatgpt finetune-whisper whisper-finetune finetuning-large-language-models
Created 2023-04-28
79 commits to main branch, last one 10 months ago
armbues
SiLLM armbues
22
227
mit
8
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
dpo llm mlx lora llm-training apple-silicon llm-inference large-language-models
Created 2024-01-11
459 commits to main branch, last one 19 hours ago
aws-samples
awsome-distributed-training aws-samples
85
202
mit-0
12
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
aws efa eks gpu llm awsbatch hyperpod llm-training generative-ai parallelcluster
Created 2023-09-30
1,091 commits to main branch, last one a day ago
substratusai
runbooks substratusai
14
169
other
7
Finetune LLMs on K8s by using Runbooks
mlops llmops kubernetes llm-serving ml-platform llm-training llm-inference kubernetes-operator
This repository has been archived (exclude archived)
Created 2023-06-19
138 commits to main branch, last one 2 months ago
Laz4rz
GPT-2 Laz4rz
5
167
unknown
2
Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
llm gpt2 gpt-2 guidelines llm-training deep-learning machine-learning deep-learning-tutorial
Created 2024-06-19
91 commits to main branch, last one 3 months ago
neo4j-labs
text2cypher neo4j-labs
18
137
cc0-1.0
5
collection of text2cypher datasets, evaluations, and finetuning instructions
llm llms graph neo4j cypher text2cypher llm-datasets llm-training cypher-query-language
Created 2024-02-05
27 commits to main branch, last one 5 months ago
MatX-inc
seqax MatX-inc
10
133
bsd-3-clause
7
seqax = sequence modeling + JAX
llm-training
Created 2024-04-26
6 commits to main branch, last one 4 months ago
yinizhilian
ICLR2024-Papers-with-Code yinizhilian
7
131
unknown
4
ICLR 2024 论文和开源项目合集
gpt llms llama3 python gemmini iclr2021 iclr2022 iclr2023 iclr2024 llm-agent transformer llm-training llm-framework llm-reasoning paperwithcode machine-learning deep-learning-paper nlp-machine-learning nlp-keywords-extraction
Created 2024-05-14
20 commits to main branch, last one 6 months ago
shivendrra
SmallLanguageModel shivendrra
16
127
mit
4
a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
gpt llms bert-model transformer llm-cookbook llm-training decoder-model neural-networks machine-learning
Created 2023-12-03
217 commits to main branch, last one 4 months ago
fiddlecube
fiddlecube-sdk fiddlecube
3
123
unknown
1
Generate ideal question-answers for testing RAG
llm-eval llm-training fine-tune-llms synthetic-data
Created 2023-07-04
59 commits to master branch, last one 4 months ago