8 results found Sort:

FMInference
FlexGen FMInference
528
9.1k
apache-2.0
109
Running large language models on a single GPU for throughput-oriented scenarios.
opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models
Created 2023-02-15
102 commits to main branch, last one 2 months ago
Haidra-Org
AI-Horde Haidra-Org
119
1.0k
agpl-3.0
16
A crowdsourced distributed cluster for AI art and text generation
ai gpt opt flask-api stable-diffusion volunteer-computing distributed-computing
Created 2022-09-13
1,149 commits to main branch, last one 4 days ago
dpressel
mint dpressel
15
245
unknown
8
MinT: Minimal Transformer Library and Tutorials
t5 gpt opt bart bert gpt2 pytorch roberta tutorials transformer transformers transformer-models sentence-transformers
Created 2022-03-23
44 commits to main branch, last one 2 years ago
Sea-Snell
JAXSeq Sea-Snell
17
187
mit
10
Train very large language models in Jax.
jax opt flax gpt2 gpt3 huggingface deep-learning language-models
Created 2022-10-02
74 commits to main branch, last one 8 months ago
ModelTC
llmc ModelTC
9
116
apache-2.0
8
This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and also an efficient LLM compression tool w...
awq llm opt ptq tool llama falcon llama2 llama3 pruning internlm benchmark internlm2 omniquant deployment evaluation smoothquant quantization large-language-models post-training-quantization
Created 2024-03-06
62 commits to main branch, last one 4 days ago
coder089
otp-bot-new-version coder089
59
114
mit
5
New OTP Bot, working with any company or service name to fetch otp code.
bot opt otp bypass opt-bot otp-bot advanced telegram bypass-otp advanced-bot telegram-bot
Created 2022-11-23
124 commits to main branch, last one a day ago
ssbuild
llm_finetuning ssbuild
12
93
unknown
2
Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on
gpt opt gpt2 lora bloom llama qlora cpmant llama2 adalora mistral
Created 2023-04-02
245 commits to dev branch, last one 2 months ago
atcarter714
UnityH4xx atcarter714
1
42
other
2
Hacks, tricks and wizardry for Unity to enhance performance or make impossible things possible ...
opt hack msil perf ilasm unity arkaen csharp dotnet 1337-hax game-dev performance gamedevnerds game-development
Created 2022-12-05
18 commits to main branch, last one about a year ago