35 results found Sort:

hiyouga
LLaMA-Factory hiyouga
2.9k
23.4k
apache-2.0
160
Unify Efficient Fine-Tuning of 100+ LLMs
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
1,568 commits to main branch, last one a day ago
yangjianxin1
Firefly yangjianxin1
452
4.9k
unknown
51
Firefly: 大模型训练工具，支持训练Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora alpaca aquila llama2 llama3 xverse zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
169 commits to master branch, last one 10 days ago
mymusise
ChatGLM-Tuning mymusise
443
3.7k
mit
31
基于ChatGLM-6B + LoRA的Fintune方案
lora peft chatglm chatgpt
Created 2023-03-16
59 commits to master branch, last one 6 months ago
hiyouga
ChatGLM-Efficient-Tuning hiyouga
462
3.6k
apache-2.0
32
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
lora peft rlhf qlora alpaca chatglm chatgpt pytorch chatglm2 fine-tuning huggingface transformers language-model
This repository has been archived (exclude archived)
Created 2023-04-08
287 commits to main branch, last one 7 months ago
InternLM
xtuner InternLM
225
2.9k
apache-2.0
30
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
285 commits to main branch, last one 3 days ago
stochasticai
xTuring stochasticai
197
2.5k
apache-2.0
32
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
591 commits to main branch, last one 2 months ago
lxe
simple-llm-finetuner lxe
135
2.0k
mit
20
Simple UI for LLM Model Finetuning
ai llm peft gpt-2 gpt-3 llama pytorch huggingface huggingface-transformers
Created 2023-03-22
46 commits to master branch, last one 5 months ago
modelscope
swift modelscope
168
1.7k
apache-2.0
15
ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 25+ MLLMs
awq dpo llm sft lora lvlm peft qwen agent llama llava deploy galore llama3 unsloth finetune paligemma modelscope multimodal pre-training
Created 2023-08-01
584 commits to main branch, last one 22 hours ago
ashishpatel26
LLM-Finetuning ashishpatel26
461
1.7k
unknown
25
LLM Finetuning with peft
llm llms lora peft llama falcon llama2 pytorch fine-tuning huggingface text-generation
Created 2023-06-08
39 commits to main branch, last one about a month ago
zyds
transformers-code zyds
202
1.3k
unknown
13
手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube
peft huggingface transformers
Created 2023-05-10
43 commits to master branch, last one about a month ago
zetavg
LLaMA-LoRA-Tuner zetavg
79
430
unknown
7
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
ai gpt lora peft gpt-j llama alpaca alpaca-lora google-colab language-model machine-learning
Created 2023-04-03
199 commits to main branch, last one about a year ago
Guitaricet
relora Guitaricet
34
409
apache-2.0
8
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
nlp peft llama transformer deep-learning distributed-training
Created 2023-04-27
217 commits to main branch, last one 4 months ago
mindspore-courses
step_into_llm mindspore-courses
79
352
apache-2.0
9
MindSpore online courses: Step into LLM
gpt llm moe nlp bert gpt2 peft rlhf llama llama2 chatglm chatgpt chatglm2 codegeex mindspore prompt-tuning instruction-tuning parallel-computing large-language-models natural-language-processing
Created 2023-03-21
91 commits to master branch, last one 2 months ago
ddlBoJack
SLAM-LLM ddlBoJack
26
344
mit
18
Speech, Language, Audio, Music Processing with Large Language Model
peft audio-processing music-processing speech-processing large-language-model multimodal-large-language-models
Created 2023-10-23
598 commits to main branch, last one 17 hours ago
Joyce94
LLM-RLHF-Tuning Joyce94
15
327
unknown
2
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
llm ppo lora peft rlhf llama fine-tuning language-model reinforcement-learning
Created 2023-06-12
28 commits to main branch, last one 7 months ago
iamarunbrahma
finetuned-qlora-falcon7b-medical iamarunbrahma
26
218
mit
4
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
llm lora peft qlora falcon chatbot chatbots falcon-7b healthcare fine-tuning mental-health conversational-ai
Created 2023-07-21
20 commits to main branch, last one 4 months ago
jackaduma
Vicuna-LoRA-RLHF-PyTorch jackaduma
18
199
mit
8
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT...
gpt llm ppo lora peft rlhf llama vicuna chatgpt pytorch finetune vicuna-7b reward-models
Created 2023-04-22
21 commits to main branch, last one about a year ago
TUDB-Labs
mLoRA TUDB-Labs
30
191
apache-2.0
3
Provide Efficient LLM Fine-Tune via Multi-LoRA Optimization
gpu llm lora peft llama llama2 chatglm baichuan finetune
Created 2023-08-24
253 commits to main branch, last one about a month ago
km1994
llms_paper km1994
8
186
unknown
4
该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）
qa rag llms lora peft agent
Created 2023-11-23
7 commits to main branch, last one 2 months ago
jianzhnie
open-chatgpt jianzhnie
30
164
apache-2.0
11
The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.
gpt llm ppo lora peft rlhf llama chatgpt stanford-alpaca
Created 2023-03-08
471 commits to main branch, last one 9 days ago
jasonvanf
llama-trl jasonvanf
22
160
apache-2.0
2
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
gpt ppo trl lora peft rlhf gpt-4 llama adapter chatgpt transformer
Created 2023-03-30
66 commits to main branch, last one about a year ago
calpt
awesome-adapter-resources calpt
7
156
isc
4
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
nlp peft awesome adapters transformers deep-learning parameter-efficient-tuning natural-language-processing parameter-efficient-learning
Created 2023-04-10
12 commits to main branch, last one 27 days ago
jackaduma
ChatGLM-LoRA-RLHF-PyTorch jackaduma
11
119
mit
5
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatG...
gpt llm ppo lora peft rlhf llama chatglm chatgpt pytorch finetune deepspeed chatglm-6b reward-models
Created 2023-04-18
17 commits to main branch, last one about a year ago
liuqidong07
MOELoRA-peft liuqidong07
10
91
mit
3
[SIGIR'24] The official implementation code of MOELoRA.
peft chatglm multi-task mixture-of-experts multitask-learning low-rank-adaptation peft-fine-tuning-llm large-language-models parameter-efficient-fine-tuning
Created 2023-10-19
20 commits to master branch, last one 4 days ago
ZhengxiangShi
DePT ZhengxiangShi
14
84
mit
2
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
nlp peft fine-tuning prompt-tuning language-model transfer-learning nlp-machine-learning large-language-models parameter-efficient-tuning natural-language-processing parameter-efficient-fine-tuning
Created 2023-09-11
29 commits to main branch, last one about a month ago
kamalkraj
e5-mistral-7b-instruct kamalkraj
13
61
apache-2.0
3
Finetune mistral-7b-instruct for sentence embeddings
lora peft pytorch finetuning mistral-7b huggingface transformers sentence-embeddings
Created 2024-01-06
7 commits to master branch, last one 29 days ago
ziplab
SPT ziplab
2
54
mit
5
[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
lora peft adapter prompt-tuning transfer-learning parameter-efficient-fine-tuning
Created 2023-03-15
9 commits to main branch, last one 8 months ago
NisaarAgharia
Indian-LawyerGPT NisaarAgharia
24
53
unknown
4
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
gpt llms peft llama qlora falcon llama2 fine-tuning large-language-models huggingface-transformers
Created 2023-06-08
54 commits to main branch, last one 3 months ago
jackaduma
Alpaca-LoRA-RLHF-PyTorch jackaduma
6
52
mit
5
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT...
gpt llm ppo lora peft rlhf llama alpaca chatgpt pytorch finetune deepspeed reward-models
Created 2023-04-18
25 commits to main branch, last one about a year ago
zjohn77
lightning-mlflow-hf zjohn77
7
46
apache-2.0
2
Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
llm nlp lora peft qlora mlflow polars adapter pytorch azure-ml hugging-face deep-learning language-model pytorch-lightning
Created 2023-11-05
23 commits to main branch, last one 6 months ago