Search Results - RepositoryStats

8

146

apache-2.0

4

[NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising

text-to-image text-to-video training-free diffusion-models stable-diffusion efficient-inference distributed-computing inference-acceleration

Created 2024-05-31

63 commits to main branch, last one 3 days ago

10

126

apache-2.0

1

⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

inference generative-ai llm-inference computer-vision machine-learning inference-acceleration

Created 2023-04-16

358 commits to main branch, last one 4 months ago

1

36

unknown

1

This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"

long-context fast-inference kv-cache-compression large-language-models inference-acceleration

Created 2024-06-11

8 commits to master branch, last one 2 months ago