1 result found Sort:

aws-samples
foundation-model-benchmarking-tool aws-samples
32
213
mit-0
8
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
g5 g6 p5 g6e p4d llama2 llama3 bedrock trainium benchmark sagemaker inferentia benchmarking generative-ai foundation-models evaluation-metrics
Created 2024-01-09
1,315 commits to main branch, last one 4 days ago