jackaduma / ChatGLM-LoRA-RLHF-PyTorch

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

Date Created 2023-04-18 (about a year ago)

Commits 17 (last one about a year ago)

Stargazers 119 (0 this week)

Watchers 5 (0 this week)

Forks 10

License mit

Ranking

RepositoryStats indexes 534,880 repositories, of these jackaduma/ChatGLM-LoRA-RLHF-PyTorch is ranked #242,268 (55th percentile) for total stargazers, and #317,334 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #43,362/103,597.

jackaduma/ChatGLM-LoRA-RLHF-PyTorch is also tagged with popular topics, for these it's ranked: pytorch (#3,098/5590), chatgpt (#1,171/2306), llm (#1,088/2049), gpt (#490/970), llama (#261/438), lora (#121/236)

Other Information

jackaduma/ChatGLM-LoRA-RLHF-PyTorch has Github issues enabled, there are 2 open issues and 0 closed issues.

All Topics

gpt llm ppo lora peft rlhf llama chatglm chatgpt pytorch finetune deepspeed chatglm-6b reward-models

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

17 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The only known language in this repository is Python

updated: 2024-06-08 @ 03:43am, id: 629344357 / R_kgDOJYMIZQ