2 results found Sort:

HarleysZhang
llm_profiler HarleysZhang
2
30
unknown
2
llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
llm llama python3 profiler transformer llm-inference gpu-performance
Created 2023-07-26
8 commits to main branch, last one 16 days ago
bikram20
Kubernetes-for-Machine-Learning bikram20
5
29
mit
4
Hands-on Machine Learning Infrastructure on Kubernetes. Using Microk8s/Ubuntu on Paperspace Cloud.
gpu microk8s kubernetes gpu-performance nvidia-device-plugin nvidia-container-toolkit
Created 2023-12-26
29 commits to main branch, last one 6 months ago