Search Results - RepositoryStats

540

9.1k

apache-2.0

111

Running large language models on a single GPU for throughput-oriented scenarios.

opt gpt-3 offloading deep-learning high-throughput machine-learning large-language-models

Created 2023-02-15

104 commits to main branch, last one a day ago

225

2.3k

mit

29

Run Mixtral-8x7B models in Colab or consumer desktops

llm pytorch offloading google-colab quantization deep-learning colab-notebook language-model mixture-of-experts

Created 2023-12-15

86 commits to master branch, last one 8 months ago

105

885

bsd-3-clause

38

PyTorch native quantization and sparsity for training and inference

mx brrr cuda llama dtypes float8 pytorch sparsity training inference optimizer offloading transformer quantization

Created 2023-11-03

589 commits to main branch, last one 6 hours ago

45

89

mit

13

dpdk infrastructure for software acceleration. Currently working on RX and ACL pre-filter

acl dpdk suricata offloading

Created 2019-06-10

107 commits to master branch, last one 3 years ago

22

56

lgpl-2.1

6

DPU-Powered File System Virtualization over virtio-fs

dpu cloud linux storage smartnic bluefield framework virtio-fs datacenter filesystem offloading virtualization

Created 2022-07-20

371 commits to master branch, last one 11 months ago