35 results found Sort:

hiyouga
LLaMA-Factory hiyouga
4.5k
36.5k
apache-2.0
218
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
ai gpt llm moe lora peft qwen rlhf agent llama qlora llama3 chatglm mistral fine-tuning quantization transformers language-model instruction-tuning large-language-models
Created 2023-05-28
2,493 commits to main branch, last one 12 hours ago
unslothai
unsloth unslothai
1.4k
19.5k
apache-2.0
135
Finetune Llama 3.3, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory
ai llm llms lora phi3 gemma llama qlora gemma2 llama3 mistral unsloth finetuning fine-tuning
Created 2023-11-29
595 commits to main branch, last one a day ago
yangjianxin1
Firefly yangjianxin1
532
6.0k
unknown
55
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
gpt llm lora peft qwen gemma llama qlora qwen2 alpaca aquila llama2 llama3 zephyr chatglm minicpm mistral mixtral baichuan internlm
Created 2023-04-02
179 commits to master branch, last one about a month ago
lyogavin
airllm lyogavin
437
5.5k
apache-2.0
130
AirLLM 70B inference with single 4GB GPU
llm lora llama qlora finetune chinese-llm chinese-nlp open-models open-source instruct-gpt generative-ai instruction-set open-source-models
Created 2023-06-12
266 commits to main branch, last one 26 days ago
hiyouga
ChatGLM-Efficient-Tuning hiyouga
473
3.7k
apache-2.0
32
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
lora peft rlhf qlora alpaca chatglm chatgpt pytorch chatglm2 fine-tuning huggingface transformers language-model
This repository has been archived (exclude archived)
Created 2023-04-08
287 commits to main branch, last one about a year ago
iusztinpaul
hands-on-llms iusztinpaul
492
3.1k
mit
48
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦�...
aws beam cicd llms mlops qlora docker llmops qdrant bytewax comet-ml langchain streaming fine-tuning huggingface transformers generative-ai 3-pipeline-design
This repository has been archived (exclude archived)
Created 2023-06-28
141 commits to main branch, last one 12 days ago
ssbuild
chatglm_finetuning ssbuild
176
1.5k
unknown
20
chatglm 6b finetuning and alpaca finetuning
ia3 sft lora qlora freeze adalora chatglm pytorch p-tuning-v2 deep-learning
Created 2023-03-14
345 commits to dev branch, last one 8 months ago
georgian-io
LLM-Finetuning-Toolkit georgian-io
92
793
apache-2.0
16
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
nlp lora qlora falcon llama2 zephyr flan-t5 llm-test redpajama finetuning mistral-7b fine-tuning unit-testing summarization ablation-study classification nlp-machine-learning large-language-models
Created 2023-07-24
540 commits to main branch, last one 2 months ago
X-D-Lab
MindChat X-D-Lab
52
626
gpl-3.0
13
🐋MindChat（漫谈）——心理大模型：漫谈人生路, 笑对风霜途
llm lora qwen qlora qwen2 chatgpt qwen-7b qwen1-5 internlm domain-llm chatglm2-6b baichuan-13b large-language-models
Created 2023-07-06
172 commits to main branch, last one 3 months ago
jianzhnie
LLamaTuner jianzhnie
63
583
apache-2.0
9
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
dpo ppo qwen rlhf llama qlora llama3 chatgpt mixtral
Created 2023-05-25
537 commits to main branch, last one 5 months ago
X-D-Lab
Sunsimiao X-D-Lab
24
407
apache-2.0
3
🌿孙思邈中文医疗大模型(Sunsimiao)：提供安全、可靠、普惠的中文医疗大模型
llm qlora chatgpt medical baichuan modelscope baichuan-7b huggingface large-language-models
Created 2023-06-20
60 commits to master branch, last one 3 months ago
yangjianxin1
Firefly-LLaMA2-Chinese yangjianxin1
32
401
unknown
11
Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
llm lora qwen bloom llama qlora falcon llama2 xverse chatglm firefly llama-2 baichuan internlm pretrain baichaun2 baichuan-13b
Created 2023-07-19
40 commits to master branch, last one about a year ago
ddzipp
AutoAudit ddzipp
33
267
mit
6
AutoAudit—— the LLM for Cyber Security 网络安全大语言模型
gpt lora llama qlora fine-tuning cyber-security security-tools
Created 2023-06-27
78 commits to main branch, last one 29 days ago
WangRongsheng
Aurora WangRongsheng
21
259
apache-2.0
7
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
gpt llm lora qlora chinese mixtral fine-tuning mixtral-8x7b language-model instruction-tuning large-language-models mixtral-8x7b-instruct
Created 2023-12-18
83 commits to main branch, last one 7 months ago
iamarunbrahma
finetuned-qlora-falcon7b-medical iamarunbrahma
27
244
mit
4
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
llm lora peft qlora falcon chatbot chatbots falcon-7b healthcare fine-tuning mental-health conversational-ai
Created 2023-07-21
20 commits to main branch, last one 11 months ago
taishan1994
Llama3.1-Finetuning taishan1994
16
166
apache-2.0
3
对llama3进行全参微调、lora微调以及qlora微调。
lora qwen qlora llama3
Created 2024-04-22
15 commits to main branch, last one 2 months ago
yangjianxin1
LongQLoRA yangjianxin1
15
160
unknown
2
LongQLoRA: Extent Context Length of LLMs Efficiently
llm lora qlora longlora long-context
Created 2023-10-22
25 commits to master branch, last one about a year ago
ssbuild
chatglm2_finetuning ssbuild
17
144
apache-2.0
3
chatglm2 6b finetuning and alpaca finetuning
ia3 lora qlora chatglm chatglm2 finetuning chatglm2-6b deep-training
Created 2023-06-25
87 commits to dev branch, last one 8 months ago
kuutsav
llm-toys kuutsav
7
125
apache-2.0
10
Small finetuned LLMs for a diverse set of useful tasks
gpt llm qlora falcon-7b finetuning paraphrase-generation dialogue-summarization
Created 2023-07-08
42 commits to main branch, last one about a year ago
GURPREETKAURJETHRA
END-TO-END-GENERATIVE-AI-PROJECTS GURPREETKAURJETHRA
44
121
mit
1
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
llm lora gpt4o llama qlora gemini llama3 llmops mistral chainlit mergekit langchain openai-api huggingface llama-index generative-ai llama3-meta-ai finetuning-llms gradio-python-llm large-language-models
Created 2024-03-21
33 commits to main branch, last one 3 months ago
ssbuild
llm_finetuning ssbuild
12
97
unknown
2
Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on
gpt opt gpt2 lora bloom llama qlora cpmant llama2 adalora mistral
Created 2023-04-02
245 commits to dev branch, last one 8 months ago
ssbuild
qwen_finetuning ssbuild
8
86
apache-2.0
2
qwen-7b and qwen-14b finetuning
ia3 lora qwen sfml qlora adalora qwen-7b qwen-14b
Created 2023-08-03
70 commits to dev branch, last one 8 months ago
taishan1994
qlora-chinese-LLM taishan1994
5
85
unknown
2
使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE
lora belle llama qlora alpaca bloomz chatglm
Created 2023-05-26
7 commits to main branch, last one about a year ago
NisaarAgharia
Indian-LawyerGPT NisaarAgharia
29
68
unknown
4
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
gpt llms peft llama qlora falcon llama2 fine-tuning large-language-models huggingface-transformers
Created 2023-06-08
54 commits to main branch, last one 10 months ago
kyegomez
Finetuning-Suite kyegomez
7
56
apache-2.0
2
Finetune any model on HF in less than 30 seconds
gpt gpt4 qlora finetuning transformer deep-learning large-language-models artificial-intelligence
Created 2023-06-13
73 commits to master branch, last one 12 months ago
zjohn77
lightning-mlflow-hf zjohn77
6
55
apache-2.0
2
Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
llm nlp lora peft qlora mlflow polars adapter pytorch azure-ml hugging-face deep-learning language-model pytorch-lightning
Created 2023-11-05
23 commits to main branch, last one about a year ago
ssbuild
moss_finetuning ssbuild
4
50
unknown
2
moss chat finetuning
sft chat lora moss qlora adalora chatmoss finetuing
Created 2023-04-21
127 commits to dev branch, last one 8 months ago
michaelnny
InstructLLaMA michaelnny
9
47
mit
0
Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the LLaMA2 model to follow human instructions, similar to InstructG...
ppo rhlf llam2 qlora instructgpt 4bit-fine-tune
Created 2023-07-08
35 commits to main branch, last one 9 months ago
AviSoori1x
Tuning-the-Finetuning AviSoori1x
12
42
apache-2.0
3
Tuning the Finetuning: An exploration of achieving success with QLoRA
llms lora qlora fine-tuning transformers large-language-models
Created 2023-08-15
10 commits to main branch, last one 7 months ago
nikolamilosevic86
verifAI nikolamilosevic86
2
40
agpl-3.0
3
VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)
llm nli nlp qlora bioasq openai pubmed qdrant medline scifact mistral-7b opensearch verification deep-learning machine-learning nlp-machine-learning biomedical-data-science hallucination-detection natural-language-processing
Created 2023-05-23
299 commits to main branch, last one 3 days ago