OVHcloud GPU benchmark - YOLO Prediction FP32

Go back to list
inference
max mean min std
provider_name flavor_name file_size
Amazon Web Services g5.xlarge 71400 72.5 63.5 58.9 7.7
138602 59.2 58.8 58.5 0.4
191185 59.3 59.1 58.9 0.2
662665 59.2 59.0 58.5 0.4
13601264 59.0 58.7 58.6 0.2
p3.2xlarge 71400 45.0 44.7 44.2 0.4
138602 45.9 45.4 45.0 0.5
191185 44.4 44.1 43.9 0.2
662665 46.6 45.4 44.3 1.2
13601264 46.4 44.8 43.4 1.5
Google Cloud a2-highgpu-1g 71400 57.5 56.8 56.3 0.6
138602 55.3 52.4 50.9 2.5
191185 55.5 55.0 54.3 0.6
662665 54.4 52.2 51.1 1.9
13601264 55.7 54.0 51.5 2.2
a2-ultragpu-1g 71400 52.6 52.2 51.5 0.6
138602 51.3 51.0 50.9 0.2
191185 51.2 50.9 50.8 0.2
662665 51.6 51.2 50.6 0.5
13601264 52.1 51.9 51.7 0.2
g2-standard-16 71400 62.9 61.9 61.3 0.6
138602 63.1 61.5 60.0 1.1
191185 63.9 61.8 60.9 1.1
662665 62.3 61.2 60.2 0.7
13601264 61.8 61.3 60.7 0.5
n1-highmem-8 Intel Skylake Tesla V100 71400 45.1 42.3 38.5 2.7
138602 43.8 40.0 37.2 2.8
191185 42.3 40.1 37.3 2.2
662665 41.9 40.7 38.4 1.7
13601264 43.5 40.5 37.0 2.5
Microsoft Azure Standard_NC40ads_H100_v5 71400 32.9 32.6 32.4 0.3
138602 33.0 32.8 32.5 0.3
191185 32.7 32.5 32.4 0.2
662665 32.4 32.3 32.1 0.2
13601264 32.5 32.5 32.4 0.1
Standard_NC6s_v3 71400 46.2 42.8 41.0 2.9
138602 43.2 41.6 40.0 1.6
191185 40.5 40.1 39.9 0.3
662665 49.4 43.5 40.6 5.1
13601264 40.4 40.3 40.2 0.1
OVHcloud H100-380 71400 32.5 32.2 31.6 0.5
138602 32.4 32.2 32.0 0.2
191185 33.0 32.4 31.7 0.7
662665 33.4 33.2 32.9 0.3
13601264 32.1 31.9 31.8 0.2
L4-90 71400 30.6 30.5 30.3 0.1
138602 30.7 30.3 30.0 0.3
191185 30.7 30.5 30.1 0.3
662665 30.8 30.7 30.6 0.1
13601264 30.2 29.9 29.6 0.3
L40S-90 71400 32.2 31.8 31.4 0.3
138602 32.8 32.1 31.7 0.4
191185 33.0 32.4 31.6 0.5
662665 33.0 32.7 32.3 0.3
13601264 33.3 31.4 30.9 1.0
T1-LE-45 71400 48.4 46.8 44.6 2.0
138602 48.4 45.3 43.4 2.7
191185 50.1 46.9 45.1 2.8
662665 48.4 45.9 42.9 2.8
13601264 43.0 42.1 40.7 1.3