45 results found Sort:

hiyouga
LLaMA-Factory hiyouga
4.3k
34.6k
apache-2.0
214
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,377 commits to main branch, last one a day ago
yangjianxin1
Firefly yangjianxin1
526
5.9k
unknown
56
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora qwen2 alpaca aquila llama2 llama3 zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
179 commits to master branch, last one 28 days ago
modelscope
ms-swift modelscope
379
4.3k
apache-2.0
24
Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...
dpo llm sft lora peft agent liger llama llava qwen2 deploy llama3 internvl megatron qwen2-vl minicpm-v modelscope multimodal reflection pre-training
Created 2023-08-01
1,169 commits to main branch, last one a day ago
InternLM
xtuner InternLM
311
4.0k
apache-2.0
34
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
llm peft phi3 qwen agent llava llama2 llama3 chatbot mixtral msagent baichuan chatglm2 chatglm3 internlm llm-training conversational-ai large-language-models supervised-finetuning
Created 2023-07-11
330 commits to main branch, last one 13 days ago
mymusise
ChatGLM-Tuning mymusise
442
3.7k
mit
31
基于ChatGLM-6B + LoRA的Fintune方案
lora peft chatglm chatgpt
Created 2023-03-16
59 commits to master branch, last one 12 months ago
hiyouga
ChatGLM-Efficient-Tuning hiyouga
470
3.7k
apache-2.0
32
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
lora peft rlhf qlora alpaca chatglm chatgpt pytorch chatglm2 fine-tuning huggingface transformers language-model
This repository has been archived (exclude archived)
Created 2023-04-08
287 commits to main branch, last one about a year ago
stochasticai
xTuring stochasticai
207
2.6k
apache-2.0
33
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...
llm lora peft gpt-2 gpt-j llama alpaca gen-ai adapter mistral finetuning fine-tuning quantization deep-learning generative-ai language-model mixed-precision
Created 2023-03-19
593 commits to main branch, last one about a month ago
ashishpatel26
LLM-Finetuning ashishpatel26
601
2.2k
unknown
32
LLM Finetuning with peft
llm llms lora peft llama falcon llama2 pytorch fine-tuning huggingface text-generation
Created 2023-06-08
46 commits to main branch, last one 4 months ago
zyds
transformers-code zyds
304
2.1k
unknown
17
手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube
peft huggingface transformers
Created 2023-05-10
47 commits to master branch, last one 4 months ago
lxe
simple-llm-finetuner lxe
132
2.0k
mit
20
Simple UI for LLM Model Finetuning
ai llm peft gpt-2 gpt-3 llama pytorch huggingface huggingface-transformers
Created 2023-03-22
46 commits to master branch, last one 11 months ago
X-LANCE
SLAM-LLM X-LANCE
52
587
mit
21
Speech, Language, Audio, Music Processing with Large Language Model
peft audio-processing music-processing speech-processing large-language-model multimodal-large-language-models
Created 2023-10-23
696 commits to main branch, last one 3 days ago
zetavg
LLaMA-LoRA-Tuner zetavg
88
444
unknown
8
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
ai gpt lora peft gpt-j llama alpaca alpaca-lora google-colab language-model machine-learning
Created 2023-04-03
199 commits to main branch, last one about a year ago
Guitaricet
relora Guitaricet
39
435
apache-2.0
7
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
nlp peft llama transformer deep-learning distributed-training
Created 2023-04-27
217 commits to main branch, last one 10 months ago
mindspore-courses
step_into_llm mindspore-courses
96
431
apache-2.0
9
MindSpore online courses: Step into LLM
gpt llm moe nlp bert gpt2 peft rlhf llama llama2 chatglm chatgpt chatglm2 codegeex mindspore prompt-tuning instruction-tuning parallel-computing large-language-models natural-language-processing
Created 2023-03-21
126 commits to master branch, last one 28 days ago
Joyce94
LLM-RLHF-Tuning Joyce94
17
371
unknown
2
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
llm ppo lora peft rlhf llama fine-tuning language-model reinforcement-learning
Created 2023-06-12
28 commits to main branch, last one about a year ago
TUDB-Labs
mLoRA TUDB-Labs
52
272
apache-2.0
3
An Efficient "Factory" to Build Multiple LoRA Adapters
dpo gpu llm lora peft rlhf llama mlora llama2 chatglm baichuan finetune
Created 2023-08-24
303 commits to main branch, last one 25 days ago
km1994
llms_paper km1994
11
263
unknown
4
该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）
qa rag llms lora peft agent
Created 2023-11-23
7 commits to main branch, last one 7 months ago
iamarunbrahma
finetuned-qlora-falcon7b-medical iamarunbrahma
27
242
mit
4
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
llm lora peft qlora falcon chatbot chatbots falcon-7b healthcare fine-tuning mental-health conversational-ai
Created 2023-07-21
20 commits to main branch, last one 10 months ago
jackaduma
Vicuna-LoRA-RLHF-PyTorch jackaduma
18
208
mit
8
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT...
gpt llm ppo lora peft rlhf llama vicuna chatgpt pytorch finetune vicuna-7b reward-models
Created 2023-04-22
21 commits to main branch, last one about a year ago
jasonvanf
llama-trl jasonvanf
23
185
apache-2.0
2
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
gpt ppo trl lora peft rlhf gpt-4 llama adapter chatgpt transformer
Created 2023-03-30
66 commits to main branch, last one about a year ago
jianzhnie
open-chatgpt jianzhnie
35
176
apache-2.0
12
The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.
gpt llm ppo lora peft rlhf llama chatgpt stanford-alpaca
Created 2023-03-08
471 commits to main branch, last one 6 months ago
calpt
awesome-adapter-resources calpt
10
176
isc
4
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
nlp peft awesome adapters transformers deep-learning parameter-efficient-tuning natural-language-processing parameter-efficient-learning
Created 2023-04-10
12 commits to main branch, last one 6 months ago
jackaduma
ChatGLM-LoRA-RLHF-PyTorch jackaduma
10
126
mit
6
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatG...
gpt llm ppo lora peft rlhf llama chatglm chatgpt pytorch finetune deepspeed chatglm-6b reward-models
Created 2023-04-18
17 commits to main branch, last one about a year ago
liuqidong07
MOELoRA-peft liuqidong07
17
125
mit
3
[SIGIR'24] The official implementation code of MOELoRA.
peft chatglm multi-task mixture-of-experts multitask-learning low-rank-adaptation peft-fine-tuning-llm large-language-models parameter-efficient-fine-tuning
Created 2023-10-19
21 commits to master branch, last one 4 months ago
ZhengxiangShi
DePT ZhengxiangShi
15
94
mit
2
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
nlp peft fine-tuning prompt-tuning language-model transfer-learning nlp-machine-learning large-language-models parameter-efficient-tuning natural-language-processing parameter-efficient-fine-tuning
Created 2023-09-11
29 commits to main branch, last one 7 months ago
simplifine-llm
Simplifine simplifine-llm
3
85
gpl-3.0
2
🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
ai gpt llm moe phi lora peft qwen cloud llama llama3 mistral fine-tuning open-source llm-training fine-tuning-llm finetuning-llms instruction-tuning large-language-models
Created 2024-07-05
189 commits to main branch, last one 3 months ago
BorealisAI
flora-opt BorealisAI
4
79
lgpl-3.0
3
This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
jax flax lora peft optax transformers deep-learning random-projection large-language-models memory-efficient-tuning
Created 2024-02-05
6 commits to main branch, last one 4 months ago
kamalkraj
e5-mistral-7b-instruct kamalkraj
16
71
apache-2.0
3
Finetune mistral-7b-instruct for sentence embeddings
lora peft pytorch finetuning mistral-7b huggingface transformers sentence-embeddings
Created 2024-01-06
7 commits to master branch, last one 6 months ago
NisaarAgharia
Indian-LawyerGPT NisaarAgharia
27
67
unknown
4
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
gpt llms peft llama qlora falcon llama2 fine-tuning large-language-models huggingface-transformers
Created 2023-06-08
54 commits to main branch, last one 9 months ago
ziplab
SPT ziplab
2
64
mit
4
[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
lora peft adapter prompt-tuning transfer-learning parameter-efficient-fine-tuning
Created 2023-03-15
9 commits to main branch, last one about a year ago