1 result found Sort:

ServerlessLLM
ServerlessLLM ServerlessLLM
33
358
apache-2.0
13
Serverless LLM Serving for Everyone.
cuda pytorch model-serving model-as-a-service serverless-inference large-language-models huggingface-transformers
Created 2024-01-23
94 commits to main branch, last one 11 hours ago