46 results found Sort:

hiyouga
LLaMA-Factory hiyouga
4.5k
36.5k
apache-2.0
218
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,493 commits to main branch, last one 11 hours ago
yangjianxin1
Firefly yangjianxin1
532
6.0k
unknown
55
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora qwen2 alpaca aquila llama2 llama3 zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
179 commits to master branch, last one about a month ago
modelscope
ms-swift modelscope
412
4.7k
apache-2.0
23
Use PEFT or Full-parameter to finetune 400+ LLMs (Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, ...) or 100+ MLLMs (Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL...
dpo llm sft lora peft vllm agent liger llama qwen2 deploy llama3 lora-ga emu3-gen internvl qwen2-vl minicpm-v modelscope multimodal pre-training
Created 2023-08-01
1,273 commits to main branch, last one 7 hours ago
InternLM
xtuner InternLM
322
4.1k
apache-2.0
36
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one about a month ago
mymusise
ChatGLM-Tuning mymusise
441
3.8k
mit
32
基于ChatGLM-6B + LoRA的Fintune方案
lora peft chatglm chatgpt
Created 2023-03-16
59 commits to master branch, last one about a year ago
hiyouga
ChatGLM-Efficient-Tuning hiyouga
473
3.7k
apache-2.0
32
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
lora peft rlhf qlora alpaca chatglm chatgpt pytorch chatglm2 fine-tuning huggingface transformers language-model
This repository has been archived (exclude archived)
Created 2023-04-08
287 commits to main branch, last one about a year ago
stochasticai
xTuring stochasticai
207
2.6k
apache-2.0
33
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
593 commits to main branch, last one 2 months ago
ashishpatel26
LLM-Finetuning ashishpatel26
618
2.2k
unknown
33
LLM Finetuning with peft
llm llms lora peft llama falcon llama2 pytorch fine-tuning huggingface text-generation
Created 2023-06-08
46 commits to main branch, last one 5 months ago
zyds
transformers-code zyds
317
2.2k
unknown
19
手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube
peft huggingface transformers
Created 2023-05-10
47 commits to master branch, last one 5 months ago
lxe
simple-llm-finetuner lxe
131
2.0k
mit
20
Simple UI for LLM Model Finetuning
ai llm peft gpt-2 gpt-3 llama pytorch huggingface huggingface-transformers
Created 2023-03-22
46 commits to master branch, last one about a year ago
X-LANCE
SLAM-LLM X-LANCE
56
617
mit
21
Speech, Language, Audio, Music Processing with Large Language Model
peft audio-processing music-processing speech-processing large-language-model multimodal-large-language-models
Created 2023-10-23
706 commits to main branch, last one 21 days ago
zetavg
LLaMA-LoRA-Tuner zetavg
90
449
unknown
8
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
ai gpt lora peft gpt-j llama alpaca alpaca-lora google-colab language-model machine-learning
Created 2023-04-03
199 commits to main branch, last one about a year ago
Guitaricet
relora Guitaricet
39
439
apache-2.0
7
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
nlp peft llama transformer deep-learning distributed-training
Created 2023-04-27
217 commits to main branch, last one 11 months ago
mindspore-courses
step_into_llm mindspore-courses
100
435
apache-2.0
9
MindSpore online courses: Step into LLM
gpt llm moe nlp bert gpt2 peft rlhf llama llama2 chatglm chatgpt chatglm2 codegeex mindspore prompt-tuning instruction-tuning parallel-computing large-language-models natural-language-processing
Created 2023-03-21
126 commits to master branch, last one about a month ago
Joyce94
LLM-RLHF-Tuning Joyce94
17
376
unknown
2
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
llm ppo lora peft rlhf llama fine-tuning language-model reinforcement-learning
Created 2023-06-12
28 commits to main branch, last one about a year ago
TUDB-Labs
mLoRA TUDB-Labs
54
284
apache-2.0
3
An Efficient "Factory" to Build Multiple LoRA Adapters
dpo gpu llm lora peft rlhf llama mlora llama2 chatglm baichuan finetune
Created 2023-08-24
306 commits to main branch, last one 12 days ago
km1994
llms_paper km1994
11
279
unknown
4
该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）
qa rag llms lora peft agent
Created 2023-11-23
7 commits to main branch, last one 8 months ago
iamarunbrahma
finetuned-qlora-falcon7b-medical iamarunbrahma
27
244
mit
4
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
llm lora peft qlora falcon chatbot chatbots falcon-7b healthcare fine-tuning mental-health conversational-ai
Created 2023-07-21
20 commits to main branch, last one 11 months ago
jackaduma
Vicuna-LoRA-RLHF-PyTorch jackaduma
18
209
mit
8
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT...
gpt llm ppo lora peft rlhf llama vicuna chatgpt pytorch finetune vicuna-7b reward-models
Created 2023-04-22
21 commits to main branch, last one about a year ago
jasonvanf
llama-trl jasonvanf
23
189
apache-2.0
2
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
gpt ppo trl lora peft rlhf gpt-4 llama adapter chatgpt transformer
Created 2023-03-30
66 commits to main branch, last one about a year ago
calpt
awesome-adapter-resources calpt
10
180
isc
4
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
nlp peft awesome adapters transformers deep-learning parameter-efficient-tuning natural-language-processing parameter-efficient-learning
Created 2023-04-10
12 commits to main branch, last one 7 months ago
jianzhnie
open-chatgpt jianzhnie
36
178
apache-2.0
12
The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.
gpt llm ppo lora peft rlhf llama chatgpt stanford-alpaca
Created 2023-03-08
471 commits to main branch, last one 7 months ago
liuqidong07
MOELoRA-peft liuqidong07
18
135
mit
3
[SIGIR'24] The official implementation code of MOELoRA.
peft chatglm multi-task mixture-of-experts multitask-learning low-rank-adaptation peft-fine-tuning-llm large-language-models parameter-efficient-fine-tuning
Created 2023-10-19
21 commits to master branch, last one 5 months ago
jackaduma
ChatGLM-LoRA-RLHF-PyTorch jackaduma
10
129
mit
6
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatG...
gpt llm ppo lora peft rlhf llama chatglm chatgpt pytorch finetune deepspeed chatglm-6b reward-models
Created 2023-04-18
17 commits to main branch, last one about a year ago
ZhengxiangShi
DePT ZhengxiangShi
15
95
mit
2
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
nlp peft fine-tuning prompt-tuning language-model transfer-learning nlp-machine-learning large-language-models parameter-efficient-tuning natural-language-processing parameter-efficient-fine-tuning
Created 2023-09-11
29 commits to main branch, last one 8 months ago
simplifine-llm
Simplifine simplifine-llm
3
85
gpl-3.0
2
🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
ai gpt llm moe phi lora peft qwen cloud llama llama3 mistral fine-tuning open-source llm-training fine-tuning-llm finetuning-llms instruction-tuning large-language-models
Created 2024-07-05
189 commits to main branch, last one 4 months ago
BorealisAI
flora-opt BorealisAI
5
84
lgpl-3.0
3
This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
jax flax lora peft optax transformers deep-learning random-projection large-language-models memory-efficient-tuning
Created 2024-02-05
6 commits to main branch, last one 5 months ago
kamalkraj
e5-mistral-7b-instruct kamalkraj
17
74
apache-2.0
3
Finetune mistral-7b-instruct for sentence embeddings
lora peft pytorch finetuning mistral-7b huggingface transformers sentence-embeddings
Created 2024-01-06
7 commits to master branch, last one 7 months ago
NisaarAgharia
Indian-LawyerGPT NisaarAgharia
29
68
unknown
4
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
gpt llms peft llama qlora falcon llama2 fine-tuning large-language-models huggingface-transformers
Created 2023-06-08
54 commits to main branch, last one 10 months ago
ziplab
SPT ziplab
2
64
mit
4
[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
lora peft adapter prompt-tuning transfer-learning parameter-efficient-fine-tuning
Created 2023-03-15
9 commits to main branch, last one about a year ago