2 results found Sort:

vllm-project
vllm vllm-project
4.9k
32.3k
apache-2.0
263
A high-throughput and memory-efficient inference and serving engine for LLMs
amd gpt hpu llm tpu xpu cuda rocm llama mlops llmops pytorch trainium inference inferentia llm-serving transformer model-serving
Created 2023-02-09
3,879 commits to main branch, last one 10 hours ago
huggingface
optimum-habana huggingface
219
162
apache-2.0
37
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
hpu bert habana fine-tuning transformers
Created 2022-03-01
1,247 commits to main branch, last one a day ago