Search Results - RepositoryStats

548

9.2k

apache-2.0

111

Running large language models on a single GPU for throughput-oriented scenarios.

opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models

Created 2023-02-15

107 commits to main branch, last one 24 days ago

226

2.3k

mit

29

Run Mixtral-8x7B models in Colab or consumer desktops

llm pytorch offloading google-colab quantization deep-learning colab-notebook language-model mixture-of-experts

Created 2023-12-15

86 commits to master branch, last one 10 months ago

177

1.6k

bsd-3-clause

41

PyTorch native quantization and sparsity for training and inference

mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization

Created 2023-11-03

776 commits to main branch, last one 14 hours ago

45

91

mit

13

dpdk infrastructure for software acceleration. Currently working on RX and ACL pre-filter

acl dpdk suricata offloading

Created 2019-06-10

107 commits to master branch, last one 3 years ago

23

62

lgpl-2.1

6

DPU-Powered File System Virtualization over virtio-fs

dpu cloud linux storage smartnic bluefield framework virtio-fs datacenter filesystem offloading virtualization

Created 2022-07-20

371 commits to master branch, last one about a year ago