OVHcloud GPU benchmark - YOLO Prediction FP16
Go back to list
|
|
|
inference |
|
|
|
max |
mean |
min |
std |
provider_name |
flavor_name |
file_size |
|
|
|
|
Amazon Web Services |
g5.xlarge |
71400 |
77.4 |
76.3 |
75.5 |
1.0 |
138602 |
75.8 |
75.6 |
75.2 |
0.3 |
191185 |
75.8 |
75.4 |
75.1 |
0.3 |
662665 |
75.7 |
75.3 |
74.9 |
0.4 |
13601264 |
75.2 |
75.1 |
74.9 |
0.2 |
p3.2xlarge |
71400 |
120.0 |
118.7 |
117.8 |
1.1 |
138602 |
120.2 |
118.9 |
118.1 |
1.1 |
191185 |
118.6 |
118.1 |
117.7 |
0.5 |
662665 |
118.0 |
117.5 |
117.1 |
0.5 |
13601264 |
118.8 |
118.1 |
117.8 |
0.5 |
Google Cloud |
a2-highgpu-1g |
71400 |
88.6 |
84.6 |
79.0 |
5.0 |
138602 |
88.2 |
86.7 |
85.3 |
1.4 |
191185 |
86.2 |
81.2 |
78.6 |
4.3 |
662665 |
87.1 |
84.5 |
79.7 |
4.1 |
13601264 |
86.5 |
82.1 |
79.6 |
3.8 |
a2-ultragpu-1g |
71400 |
83.1 |
81.6 |
79.6 |
1.8 |
138602 |
80.7 |
80.2 |
79.7 |
0.5 |
191185 |
79.2 |
78.9 |
78.5 |
0.3 |
662665 |
79.7 |
79.4 |
78.8 |
0.5 |
13601264 |
80.6 |
80.3 |
79.8 |
0.4 |
g2-standard-16 |
71400 |
98.7 |
97.3 |
96.4 |
0.8 |
138602 |
98.5 |
97.4 |
96.2 |
1.0 |
191185 |
99.1 |
97.2 |
95.7 |
1.4 |
662665 |
98.6 |
97.3 |
96.0 |
1.2 |
13601264 |
98.5 |
96.9 |
95.4 |
1.4 |
n1-highmem-8 Intel Skylake Tesla V100 |
71400 |
124.1 |
113.3 |
102.6 |
8.0 |
138602 |
118.4 |
110.4 |
99.8 |
7.9 |
191185 |
115.8 |
110.9 |
103.3 |
5.7 |
662665 |
122.0 |
113.4 |
103.5 |
7.9 |
13601264 |
121.1 |
110.6 |
98.8 |
8.2 |
Microsoft Azure |
Standard_NC40ads_H100_v5 |
71400 |
37.4 |
37.3 |
37.2 |
0.1 |
138602 |
37.4 |
37.1 |
36.9 |
0.3 |
191185 |
37.9 |
37.5 |
37.2 |
0.4 |
662665 |
37.1 |
37.0 |
36.8 |
0.1 |
13601264 |
37.2 |
37.1 |
37.0 |
0.1 |
Standard_NC6s_v3 |
71400 |
115.8 |
108.9 |
104.1 |
6.2 |
138602 |
108.9 |
107.0 |
105.7 |
1.7 |
191185 |
107.3 |
105.0 |
103.3 |
2.1 |
662665 |
127.5 |
112.9 |
105.5 |
12.7 |
13601264 |
104.2 |
103.6 |
103.2 |
0.5 |
OVHcloud |
H100-380 |
71400 |
200.6 |
200.0 |
198.9 |
1.0 |
138602 |
223.4 |
207.6 |
199.4 |
13.7 |
191185 |
202.4 |
202.0 |
201.5 |
0.4 |
662665 |
228.7 |
211.5 |
202.7 |
14.9 |
13601264 |
225.6 |
216.7 |
200.4 |
14.1 |
L4-90 |
71400 |
50.1 |
49.3 |
48.3 |
0.9 |
138602 |
49.6 |
49.5 |
49.2 |
0.3 |
191185 |
49.7 |
48.9 |
47.8 |
1.0 |
662665 |
50.0 |
49.3 |
48.9 |
0.6 |
13601264 |
49.0 |
48.5 |
48.0 |
0.5 |
L40S-90 |
71400 |
51.2 |
50.9 |
50.3 |
0.3 |
138602 |
52.8 |
51.2 |
50.5 |
0.8 |
191185 |
51.7 |
51.2 |
50.4 |
0.5 |
662665 |
52.6 |
51.4 |
50.7 |
0.8 |
13601264 |
50.7 |
49.9 |
49.5 |
0.4 |
T1-LE-45 |
71400 |
129.1 |
121.7 |
114.7 |
7.2 |
138602 |
110.3 |
109.6 |
108.6 |
0.9 |
191185 |
117.1 |
114.1 |
111.9 |
2.7 |
662665 |
109.8 |
108.1 |
106.0 |
1.9 |
13601264 |
113.6 |
109.2 |
105.2 |
4.2 |