AWS 2023 VM Renewing: m7i & m7a - DeepSparse

Go back to list

Filter:

items_per_sec
mean std
flavor_name domain subdomain model
m6a.8xlarge cv classification efficientnet-b0 4231.8 93.5
resnet_v1-50 749.1 9.9
detection yolov5-l 39.0 0.3
yolov5-s 152.7 2.3
nlp question_answering bert-base 98.7 1.1
distilbert-none 90.7 1.6
text_classification distilbert-none 497.7 11.9
m6i.8xlarge cv classification efficientnet-b0 4703.0 62.0
resnet_v1-50 1206.5 3.3
detection yolov5-l 67.1 1.1
yolov5-s 298.8 2.4
nlp question_answering bert-base 158.2 0.1
distilbert-none 152.0 0.7
text_classification distilbert-none 768.5 4.0
m7a.8xlarge cv classification efficientnet-b0 4003.6 12.4
resnet_v1-50 1558.4 12.3
detection yolov5-l 85.9 0.2
yolov5-s 362.2 1.3
nlp question_answering bert-base 199.6 1.0
distilbert-none 178.0 7.7
text_classification distilbert-none 1042.4 34.6
m7i.8xlarge cv classification efficientnet-b0 5516.4 200.5
resnet_v1-50 1571.2 64.1
detection yolov5-l 90.7 2.7
yolov5-s 404.3 10.9
nlp question_answering bert-base 178.9 3.4
distilbert-none 178.7 10.0
text_classification distilbert-none 992.1 44.1