1 result found Sort:

ServerlessLLM
ServerlessLLM ServerlessLLM
40
458
apache-2.0
13
Serverless LLM Serving for Everyone.
cuda pytorch model-serving model-as-a-service serverless-inference large-language-models huggingface-transformers
Created 2024-01-23
146 commits to main branch, last one 5 days ago