OVHcloud GPU benchmark - YOLO Prediction FP16

Go back to list

inference
max mean min std
provider_name flavor_name file_size
Amazon Web Services g5.xlarge 71400 77.4 76.3 75.5 1.0
138602 75.8 75.6 75.2 0.3
191185 75.8 75.4 75.1 0.3
662665 75.7 75.3 74.9 0.4
13601264 75.2 75.1 74.9 0.2
p3.2xlarge 71400 120.0 118.7 117.8 1.1
138602 120.2 118.9 118.1 1.1
191185 118.6 118.1 117.7 0.5
662665 118.0 117.5 117.1 0.5
13601264 118.8 118.1 117.8 0.5
Google Cloud a2-highgpu-1g 71400 88.6 84.6 79.0 5.0
138602 88.2 86.7 85.3 1.4
191185 86.2 81.2 78.6 4.3
662665 87.1 84.5 79.7 4.1
13601264 86.5 82.1 79.6 3.8
a2-ultragpu-1g 71400 83.1 81.6 79.6 1.8
138602 80.7 80.2 79.7 0.5
191185 79.2 78.9 78.5 0.3
662665 79.7 79.4 78.8 0.5
13601264 80.6 80.3 79.8 0.4
g2-standard-16 71400 98.7 97.3 96.4 0.8
138602 98.5 97.4 96.2 1.0
191185 99.1 97.2 95.7 1.4
662665 98.6 97.3 96.0 1.2
13601264 98.5 96.9 95.4 1.4
n1-highmem-8 Intel Skylake Tesla V100 71400 124.1 113.3 102.6 8.0
138602 118.4 110.4 99.8 7.9
191185 115.8 110.9 103.3 5.7
662665 122.0 113.4 103.5 7.9
13601264 121.1 110.6 98.8 8.2
Microsoft Azure Standard_NC40ads_H100_v5 71400 37.4 37.3 37.2 0.1
138602 37.4 37.1 36.9 0.3
191185 37.9 37.5 37.2 0.4
662665 37.1 37.0 36.8 0.1
13601264 37.2 37.1 37.0 0.1
Standard_NC6s_v3 71400 115.8 108.9 104.1 6.2
138602 108.9 107.0 105.7 1.7
191185 107.3 105.0 103.3 2.1
662665 127.5 112.9 105.5 12.7
13601264 104.2 103.6 103.2 0.5
OVHcloud H100-380 71400 200.6 200.0 198.9 1.0
138602 223.4 207.6 199.4 13.7
191185 202.4 202.0 201.5 0.4
662665 228.7 211.5 202.7 14.9
13601264 225.6 216.7 200.4 14.1
L4-90 71400 50.1 49.3 48.3 0.9
138602 49.6 49.5 49.2 0.3
191185 49.7 48.9 47.8 1.0
662665 50.0 49.3 48.9 0.6
13601264 49.0 48.5 48.0 0.5
L40S-90 71400 51.2 50.9 50.3 0.3
138602 52.8 51.2 50.5 0.8
191185 51.7 51.2 50.4 0.5
662665 52.6 51.4 50.7 0.8
13601264 50.7 49.9 49.5 0.4
T1-LE-45 71400 129.1 121.7 114.7 7.2
138602 110.3 109.6 108.6 0.9
191185 117.1 114.1 111.9 2.7
662665 109.8 108.1 106.0 1.9
13601264 113.6 109.2 105.2 4.2