53 results found Sort:

hiyouga
LLaMA-Factory hiyouga
5.6k
45.7k
apache-2.0
251
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,735 commits to main branch, last one 2 days ago
modelscope
ms-swift modelscope
567
6.6k
apache-2.0
33
Use PEFT or Full-parameter to finetune 500+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Llama3.2-Vision, Llava, I...
llm rft sft grpo lora omni peft liger llama deploy distill open-r1 qwen2-5 internvl llama3-3 megatron qwen2-vl embedding multimodal deepseek-r1
Created 2023-08-01
1,686 commits to main branch, last one 2 days ago
yangjianxin1
Firefly yangjianxin1
570
6.3k
unknown
58
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora qwen2 alpaca aquila llama2 llama3 zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
179 commits to master branch, last one 5 months ago
InternLM
xtuner InternLM
335
4.4k
apache-2.0
36
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
336 commits to main branch, last one about a month ago
mymusise
ChatGLM-Tuning mymusise
445
3.8k
mit
33
基于ChatGLM-6B + LoRA的Fintune方案
lora peft chatglm chatgpt
Created 2023-03-16
59 commits to master branch, last one about a year ago
hiyouga
ChatGLM-Efficient-Tuning hiyouga
474
3.7k
apache-2.0
32
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
lora peft rlhf qlora alpaca chatglm chatgpt pytorch chatglm2 fine-tuning huggingface transformers language-model
This repository has been archived (exclude archived)
Created 2023-04-08
287 commits to main branch, last one about a year ago
zyds
transformers-code zyds
366
2.7k
unknown
20
手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube
peft huggingface transformers
Created 2023-05-10
47 commits to master branch, last one 8 months ago
stochasticai
xTuring stochasticai
206
2.6k
apache-2.0
34
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
593 commits to main branch, last one 6 months ago
ashishpatel26
LLM-Finetuning ashishpatel26
649
2.4k
unknown
34
LLM Finetuning with peft
llm llms lora peft llama falcon llama2 pytorch fine-tuning huggingface text-generation
Created 2023-06-08
50 commits to main branch, last one about a month ago
lxe
simple-llm-finetuner lxe
129
2.1k
mit
20
Simple UI for LLM Model Finetuning
ai llm peft gpt-2 gpt-3 llama pytorch huggingface huggingface-transformers
Created 2023-03-22
46 commits to master branch, last one about a year ago
X-LANCE
SLAM-LLM X-LANCE
76
763
mit
23
Speech, Language, Audio, Music Processing with Large Language Model
peft audio-processing music-processing speech-processing large-language-model multimodal-large-language-models
Created 2023-10-23
886 commits to main branch, last one 24 days ago
zetavg
LLaMA-LoRA-Tuner zetavg
96
466
unknown
8
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
ai gpt lora peft gpt-j llama alpaca alpaca-lora google-colab language-model machine-learning
Created 2023-04-03
199 commits to main branch, last one about a year ago
mindspore-courses
step_into_llm mindspore-courses
110
455
apache-2.0
8
MindSpore online courses: Step into LLM
gpt llm moe nlp bert gpt2 peft rlhf llama llama2 chatglm chatgpt chatglm2 codegeex mindspore prompt-tuning instruction-tuning parallel-computing large-language-models natural-language-processing
Created 2023-03-21
131 commits to master branch, last one 2 months ago
Guitaricet
relora Guitaricet
37
448
apache-2.0
8
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
nlp peft llama transformer deep-learning distributed-training
Created 2023-04-27
217 commits to main branch, last one about a year ago
Joyce94
LLM-RLHF-Tuning Joyce94
18
404
unknown
3
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
llm ppo lora peft rlhf llama fine-tuning language-model reinforcement-learning
Created 2023-06-12
28 commits to main branch, last one about a year ago
ModelCloud
GPTQModel ModelCloud
56
403
apache-2.0
4
Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.
gptq peft vllm sglang optimum quantization transformers
Created 2024-06-17
2,116 commits to main branch, last one 2 days ago
GraphPKU
PiSSA GraphPKU
17
336
unknown
4
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
peft fine-tuning quantization
Created 2024-03-12
101 commits to main branch, last one about a month ago
km1994
llms_paper km1994
12
306
unknown
4
该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）
qa rag llms lora peft agent
Created 2023-11-23
7 commits to main branch, last one about a year ago
TUDB-Labs
mLoRA TUDB-Labs
57
305
apache-2.0
3
An Efficient "Factory" to Build Multiple LoRA Adapters
dpo gpu llm lora peft rlhf llama mlora llama2 chatglm baichuan finetune
Created 2023-08-24
310 commits to main branch, last one about a month ago
iamarunbrahma
finetuned-qlora-falcon7b-medical iamarunbrahma
26
250
mit
4
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
llm lora peft qlora falcon chatbot chatbots falcon-7b healthcare fine-tuning mental-health conversational-ai
Created 2023-07-21
20 commits to main branch, last one about a year ago
jackaduma
Vicuna-LoRA-RLHF-PyTorch jackaduma
19
212
mit
7
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT...
gpt llm ppo lora peft rlhf llama vicuna chatgpt pytorch finetune vicuna-7b reward-models
Created 2023-04-22
21 commits to main branch, last one about a year ago
jasonvanf
llama-trl jasonvanf
23
208
apache-2.0
2
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
gpt ppo trl lora peft rlhf gpt-4 llama adapter chatgpt transformer
Created 2023-03-30
66 commits to main branch, last one about a year ago
calpt
awesome-adapter-resources calpt
11
188
isc
4
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
nlp peft awesome adapters transformers deep-learning parameter-efficient-tuning natural-language-processing parameter-efficient-learning
Created 2023-04-10
12 commits to main branch, last one 11 months ago
liuqidong07
MOELoRA-peft liuqidong07
19
154
mit
3
[SIGIR'24] The official implementation code of MOELoRA.
peft chatglm multi-task mixture-of-experts multitask-learning low-rank-adaptation peft-fine-tuning-llm large-language-models parameter-efficient-fine-tuning
Created 2023-10-19
21 commits to master branch, last one 8 months ago
jackaduma
ChatGLM-LoRA-RLHF-PyTorch jackaduma
10
134
mit
6
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatG...
gpt llm ppo lora peft rlhf llama chatglm chatgpt pytorch finetune deepspeed chatglm-6b reward-models
Created 2023-04-18
17 commits to main branch, last one about a year ago
BorealisAI
flora-opt BorealisAI
5
102
lgpl-3.0
2
This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
jax flax lora peft optax transformers deep-learning random-projection large-language-models memory-efficient-tuning
Created 2024-02-05
6 commits to main branch, last one 9 months ago
ZhengxiangShi
DePT ZhengxiangShi
16
96
mit
2
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
nlp peft fine-tuning prompt-tuning language-model transfer-learning nlp-machine-learning large-language-models parameter-efficient-tuning natural-language-processing parameter-efficient-fine-tuning
Created 2023-09-11
29 commits to main branch, last one 11 months ago
simplifine-llm
Simplifine simplifine-llm
4
89
gpl-3.0
2
🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
ai gpt llm moe phi lora peft qwen cloud llama llama3 mistral fine-tuning open-source llm-training fine-tuning-llm finetuning-llms instruction-tuning large-language-models
Created 2024-07-05
189 commits to main branch, last one 7 months ago
TUDB-Labs
MoE-PEFT TUDB-Labs
10
83
apache-2.0
3
An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
peft mlora mixlora peft-fine-tuning-llm
Created 2024-08-16
457 commits to main branch, last one 2 months ago
kamalkraj
e5-mistral-7b-instruct kamalkraj
18
81
apache-2.0
2
Finetune mistral-7b-instruct for sentence embeddings
lora peft pytorch finetuning mistral-7b huggingface transformers sentence-embeddings
Created 2024-01-06
7 commits to master branch, last one 11 months ago