2 results found Sort:

vllm-project
vllm vllm-project
4.6k
30.5k
apache-2.0
248
A high-throughput and memory-efficient inference and serving engine for LLMs
amd gpt hpu llm tpu xpu cuda rocm llama mlops llmops pytorch trainium inference inferentia llm-serving transformer model-serving
Created 2023-02-09
3,511 commits to main branch, last one 13 hours ago
huggingface
optimum-habana huggingface
202
153
apache-2.0
39
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
hpu bert habana fine-tuning transformers
Created 2022-03-01
1,130 commits to main branch, last one 13 hours ago