2 results found Sort:

vllm-project
vllm vllm-project
4.5k
29.7k
apache-2.0
242
A high-throughput and memory-efficient inference and serving engine for LLMs
amd gpt hpu llm tpu xpu cuda rocm llama mlops llmops pytorch trainium inference inferentia llm-serving transformer model-serving
Created 2023-02-09
3,290 commits to main branch, last one 7 hours ago
huggingface
optimum-habana huggingface
198
152
apache-2.0
40
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
hpu bert habana fine-tuning transformers
Created 2022-03-01
1,113 commits to main branch, last one 8 days ago