Search Results - RepositoryStats

15

147

unknown

4

Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

llm lora chatllama chat-llama low-rank-adaptation large-language-model large-language-models

Created 2023-03-20

27 commits to main branch, last one about a year ago

13

114

mit

3

[SIGIR'24] The official implementation code of MOELoRA.

peft chatglm multi-task mixture-of-experts multitask-learning low-rank-adaptation peft-fine-tuning-llm large-language-models parameter-efficient-fine-tuning

Created 2023-10-19

21 commits to master branch, last one 2 months ago

5

86

apache-2.0

5

A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

glue lora llama adapter llama2-7b llama3-8b lora-dash subspace-tuning pretrained-models soft-prompt-tuning low-rank-adaptation commonsense-reasoning subject-driven-generation natural-language-generation natural-language-processing natural-language-understanding parameter-efficient-fine-tuning

Created 2024-07-06

18 commits to main branch, last one 12 days ago

22

74

unknown

2

LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch

lora pytorch low-rank-adaptation paper-implementations

Created 2023-07-23

11 commits to main branch, last one about a year ago