AWS 2023 VM Renewing: m7i & m7a - DeepSparse
Go back to list| items_per_sec | |||||
|---|---|---|---|---|---|
| mean | std | ||||
| flavor_name | domain | subdomain | model | ||
| m6a.8xlarge | cv | classification | efficientnet-b0 | 4231.8 | 93.5 |
| resnet_v1-50 | 749.1 | 9.9 | |||
| detection | yolov5-l | 39.0 | 0.3 | ||
| yolov5-s | 152.7 | 2.3 | |||
| nlp | question_answering | bert-base | 98.7 | 1.1 | |
| distilbert-none | 90.7 | 1.6 | |||
| text_classification | distilbert-none | 497.7 | 11.9 | ||
| m6i.8xlarge | cv | classification | efficientnet-b0 | 4703.0 | 62.0 |
| resnet_v1-50 | 1206.5 | 3.3 | |||
| detection | yolov5-l | 67.1 | 1.1 | ||
| yolov5-s | 298.8 | 2.4 | |||
| nlp | question_answering | bert-base | 158.2 | 0.1 | |
| distilbert-none | 152.0 | 0.7 | |||
| text_classification | distilbert-none | 768.5 | 4.0 | ||
| m7a.8xlarge | cv | classification | efficientnet-b0 | 4003.6 | 12.4 |
| resnet_v1-50 | 1558.4 | 12.3 | |||
| detection | yolov5-l | 85.9 | 0.2 | ||
| yolov5-s | 362.2 | 1.3 | |||
| nlp | question_answering | bert-base | 199.6 | 1.0 | |
| distilbert-none | 178.0 | 7.7 | |||
| text_classification | distilbert-none | 1042.4 | 34.6 | ||
| m7i.8xlarge | cv | classification | efficientnet-b0 | 5516.4 | 200.5 |
| resnet_v1-50 | 1571.2 | 64.1 | |||
| detection | yolov5-l | 90.7 | 2.7 | ||
| yolov5-s | 404.3 | 10.9 | |||
| nlp | question_answering | bert-base | 178.9 | 3.4 | |
| distilbert-none | 178.7 | 10.0 | |||
| text_classification | distilbert-none | 992.1 | 44.1 | ||