Search Results - RepositoryStats

LLaMA-Factory hiyouga

2.9k

23.4k

apache-2.0

160

Unify Efficient Fine-Tuning of 100+ LLMs

Created 2023-05-28

1,568 commits to main branch, last one 2 days ago

unsloth unslothai

676

10.8k

apache-2.0

74

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

ai llms lora phi3 gemma llama qlora llama3 mistral finetuning fine-tuning

Created 2023-11-29

222 commits to main branch, last one a day ago

Firefly yangjianxin1

452

4.9k

unknown

51

Firefly: 大模型训练工具，支持训练Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Created 2023-04-02

169 commits to master branch, last one 10 days ago

ChatGLM-Efficient-Tuning hiyouga

462

3.6k

apache-2.0

32

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

lora peft rlhf qlora alpaca chatglm chatgpt pytorch chatglm2 fine-tuning huggingface transformers language-model

This repository has been archived (exclude archived)

Created 2023-04-08

287 commits to main branch, last one 7 months ago

Anima lyogavin

275

3.4k

apache-2.0

97

33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU

llm lora llama qlora finetune chinese-llm chinese-nlp open-models open-source instruct-gpt generative-ai instruction-set open-source-models

Created 2023-06-12

212 commits to main branch, last one about a month ago

hands-on-llms iusztinpaul

394

2.5k

mit

44

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦�...

aws beam cicd llms mlops qlora docker llmops qdrant bytewax comet-ml langchain streaming fine-tuning huggingface transformers generative-ai 3-pipeline-design

Created 2023-06-28

140 commits to main branch, last one about a month ago

chatglm_finetuning ssbuild

176

1.5k

unknown

20

chatglm 6b finetuning and alpaca finetuning

ia3 sft lora qlora freeze adalora chatglm pytorch p-tuning-v2 deep-learning

Created 2023-03-14

345 commits to dev branch, last one about a month ago

LLM-Finetuning-Toolkit georgian-io

83

692

apache-2.0

12

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

nlp lora qlora falcon llama2 zephyr flan-t5 llm-test redpajama finetuning mistral-7b fine-tuning unit-testing summarization ablation-study classification nlp-machine-learning large-language-models

Created 2023-07-24

509 commits to main branch, last one 2 days ago

LLamaTuner jianzhnie

59

535

apache-2.0

9

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

dpo ppo qwen rlhf llama qlora llama3 chatgpt mixtral

Created 2023-05-25

455 commits to main branch, last one a day ago

MindChat X-D-Lab

39

475

gpl-3.0

9

🐋MindChat（漫谈）——心理大模型：漫谈人生路, 笑对风霜途

llm lora qwen qlora qwen2 chatgpt qwen-7b qwen1-5 internlm domain-llm chatglm2-6b baichuan-13b large-language-models

Created 2023-07-06

161 commits to main branch, last one 5 days ago

Firefly-LLaMA2-Chinese yangjianxin1

25

377

unknown

11

Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

llm lora qwen bloom llama qlora falcon llama2 xverse chatglm firefly llama-2 baichuan internlm pretrain baichaun2 baichuan-13b

Created 2023-07-19

40 commits to master branch, last one 7 months ago

Sunsimiao X-D-Lab

14

261

apache-2.0

3

🌿孙思邈中文医疗大模型(Sunsimiao)：提供安全、可靠、普惠的中文医疗大模型

llm qlora chatgpt medical baichuan modelscope baichuan-7b huggingface large-language-models

Created 2023-06-20

45 commits to master branch, last one about a month ago

Aurora WangRongsheng

21

255

apache-2.0

8

🐳 Aurora is a [Chinese Version] MoE model. Aurora is a further work based on Mixtral-8x7B, which activates the chat capability of the model's Chinese open domain.

gpt llm lora qlora chinese mixtral fine-tuning mixtral-8x7b language-model instruction-tuning large-language-models mixtral-8x7b-instruct

Created 2023-12-18

83 commits to main branch, last one 22 days ago

finetuned-qlora-falcon7b-medical iamarunbrahma

26

217

mit

4

Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset

llm lora peft qlora falcon chatbot chatbots falcon-7b healthcare fine-tuning mental-health conversational-ai

Created 2023-07-21

20 commits to main branch, last one 4 months ago

chatglm2_finetuning ssbuild

17

144

apache-2.0

3

chatglm2 6b finetuning and alpaca finetuning

ia3 lora qlora chatglm chatglm2 finetuning chatglm2-6b deep-training

Created 2023-06-25

87 commits to dev branch, last one about a month ago

LongQLoRA yangjianxin1

11

143

unknown

2

LongQLoRA: Extent Context Length of LLMs Efficiently

llm lora qlora longlora long-context

Created 2023-10-22

25 commits to master branch, last one 6 months ago

llm-toys kuutsav

7

115

apache-2.0

10

Small(7B and below) finetuned LLMs for a diverse set of useful tasks

gpt llm qlora falcon-7b finetuning paraphrase-generation dialogue-summarization

Created 2023-07-08

42 commits to main branch, last one 10 months ago

llm_finetuning ssbuild

11

90

unknown

2

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on

gpt opt gpt2 lora bloom llama qlora cpmant llama2 adalora mistral

Created 2023-04-02

245 commits to dev branch, last one about a month ago

qlora-chinese-LLM taishan1994

5

85

unknown

2

使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE

lora belle llama qlora alpaca bloomz chatglm

Created 2023-05-26

7 commits to main branch, last one 11 months ago

qwen_finetuning ssbuild

5

73

apache-2.0

2

qwen-7b and qwen-14b finetuning

ia3 lora qwen sfml qlora adalora qwen-7b qwen-14b

Created 2023-08-03

70 commits to dev branch, last one about a month ago

Finetuning-Suite kyegomez

7

53

apache-2.0

2

Finetune any model on HF in less than 30 seconds

gpt gpt4 qlora finetuning transformer deep-learning large-language-models artificial-intelligence

Created 2023-06-13

73 commits to master branch, last one 5 months ago

Indian-LawyerGPT NisaarAgharia

24

53

unknown

4

Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.

gpt llms peft llama qlora falcon llama2 fine-tuning large-language-models huggingface-transformers

Created 2023-06-08

54 commits to main branch, last one 3 months ago

moss_finetuning ssbuild

4

50

unknown

2

moss chat finetuning

sft chat lora moss qlora adalora chatmoss finetuing

Created 2023-04-21

127 commits to dev branch, last one about a month ago

lightning-mlflow-hf zjohn77

7

46

apache-2.0

2

Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow

llm nlp lora peft qlora mlflow polars adapter pytorch azure-ml hugging-face deep-learning language-model pytorch-lightning

Created 2023-11-05

23 commits to main branch, last one 6 months ago

Llama3-Finetuning taishan1994

3

38

apache-2.0

3

对llama3进行全参微调、lora微调以及qlora微调。

lora qwen qlora llama3

Created 2024-04-22

5 commits to main branch, last one 16 days ago

chatglm3_finetuning ssbuild

2

35

apache-2.0

1

This repository has no description...

qlora chatglm3

Created 2023-10-27

46 commits to dev branch, last one about a month ago

Tuning-the-Finetuning AviSoori1x

8

34

apache-2.0

3

Tuning the Finetuning: An exploration of achieving success with QLoRA

llms lora qlora fine-tuning transformers large-language-models

Created 2023-08-15

10 commits to main branch, last one 22 days ago

rwkv_finetuning ssbuild

1

33

apache-2.0

1

rwkv finetuning

lora rwkv qlora rwkv4 p-tuning-v2

Created 2023-06-02

71 commits to dev branch, last one about a month ago

InstructLLaMA michaelnny

9

32

mit

0

Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the LLaMA2 model to follow human instructions, similar to InstructG...

ppo rhlf llam2 qlora instructgpt 4bit-fine-tune

Created 2023-07-08

35 commits to main branch, last one 2 months ago

baichuan_finetuning ssbuild

0

32

apache-2.0

2

baichuan and baichuan2 finetuning and alpaca finetuning

qlora baichuan fineturn baichuan-13b baichuan-chat baichuan2-13b baichuan-13b-chat baichuan2-13b-chat

Created 2023-07-11

78 commits to dev branch, last one about a month ago