6 results found Sort:

FMInference
FlexLLMGen FMInference
553
9.2k
apache-2.0
112
Running large language models on a single GPU for throughput-oriented scenarios.
opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models
This repository has been archived (exclude archived)
Created 2023-02-15
107 commits to main branch, last one about a month ago
dvmazur
mixtral-offloading dvmazur
227
2.3k
mit
29
Run Mixtral-8x7B models in Colab or consumer desktops
llm pytorch offloading google-colab quantization deep-learning colab-notebook language-model mixture-of-experts
Created 2023-12-15
86 commits to master branch, last one 11 months ago
pytorch
ao pytorch
188
1.7k
bsd-3-clause
43
PyTorch native quantization and sparsity for training and inference
mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization
Created 2023-11-03
866 commits to main branch, last one a day ago
vipinpv85
DPDK_SURICATA-4_1_1 vipinpv85
45
91
mit
13
dpdk infrastructure for software acceleration. Currently working on RX and ACL pre-filter
acl dpdk suricata offloading
Created 2019-06-10
107 commits to master branch, last one 3 years ago
IBM
DPFS IBM
23
65
lgpl-2.1
6
DPU-Powered File System Virtualization over virtio-fs
dpu cloud linux storage smartnic bluefield framework virtio-fs datacenter filesystem offloading virtualization
Created 2022-07-20
371 commits to master branch, last one about a year ago
Mellanox
ovs-tests Mellanox
13
40
unknown
10
A collection of tests for the Open vSwitch HW offload.
ovs offload offloading openvsiwtch
Created 2020-05-27
5,649 commits to master branch, last one about a month ago