2 results found Sort:

vllm-project
vllm vllm-project
4.7k
31.2k
apache-2.0
253
A high-throughput and memory-efficient inference and serving engine for LLMs
amd gpt hpu llm tpu xpu cuda rocm llama mlops llmops pytorch trainium inference inferentia llm-serving transformer model-serving
Created 2023-02-09
3,660 commits to main branch, last one 6 hours ago
omlins
ParallelStencil.jl omlins
38
326
bsd-3-clause
9
Package for writing high-level code for parallel high-performance stencil computations that can be deployed on both GPUs and CPUs
gpu xpu cuda julia stencil parallel multi-gpu multi-xpu stencil-codes staggered-grids
Created 2020-12-22
1,074 commits to main branch, last one about a month ago