OVHcloud GPU benchmark - YOLO Prediction FP16
Go back to list| inference | ||||||
|---|---|---|---|---|---|---|
| max | mean | min | std | |||
| provider_name | flavor_name | file_size | ||||
| Amazon Web Services | g5.xlarge | 71400 | 77.4 | 76.3 | 75.5 | 1.0 |
| 138602 | 75.8 | 75.6 | 75.2 | 0.3 | ||
| 191185 | 75.8 | 75.4 | 75.1 | 0.3 | ||
| 662665 | 75.7 | 75.3 | 74.9 | 0.4 | ||
| 13601264 | 75.2 | 75.1 | 74.9 | 0.2 | ||
| p3.2xlarge | 71400 | 120.0 | 118.7 | 117.8 | 1.1 | |
| 138602 | 120.2 | 118.9 | 118.1 | 1.1 | ||
| 191185 | 118.6 | 118.1 | 117.7 | 0.5 | ||
| 662665 | 118.0 | 117.5 | 117.1 | 0.5 | ||
| 13601264 | 118.8 | 118.1 | 117.8 | 0.5 | ||
| Google Cloud | a2-highgpu-1g | 71400 | 88.6 | 84.6 | 79.0 | 5.0 |
| 138602 | 88.2 | 86.7 | 85.3 | 1.4 | ||
| 191185 | 86.2 | 81.2 | 78.6 | 4.3 | ||
| 662665 | 87.1 | 84.5 | 79.7 | 4.1 | ||
| 13601264 | 86.5 | 82.1 | 79.6 | 3.8 | ||
| a2-ultragpu-1g | 71400 | 83.1 | 81.6 | 79.6 | 1.8 | |
| 138602 | 80.7 | 80.2 | 79.7 | 0.5 | ||
| 191185 | 79.2 | 78.9 | 78.5 | 0.3 | ||
| 662665 | 79.7 | 79.4 | 78.8 | 0.5 | ||
| 13601264 | 80.6 | 80.3 | 79.8 | 0.4 | ||
| g2-standard-16 | 71400 | 98.7 | 97.3 | 96.4 | 0.8 | |
| 138602 | 98.5 | 97.4 | 96.2 | 1.0 | ||
| 191185 | 99.1 | 97.2 | 95.7 | 1.4 | ||
| 662665 | 98.6 | 97.3 | 96.0 | 1.2 | ||
| 13601264 | 98.5 | 96.9 | 95.4 | 1.4 | ||
| n1-highmem-8 Intel Skylake Tesla V100 | 71400 | 124.1 | 113.3 | 102.6 | 8.0 | |
| 138602 | 118.4 | 110.4 | 99.8 | 7.9 | ||
| 191185 | 115.8 | 110.9 | 103.3 | 5.7 | ||
| 662665 | 122.0 | 113.4 | 103.5 | 7.9 | ||
| 13601264 | 121.1 | 110.6 | 98.8 | 8.2 | ||
| Microsoft Azure | Standard_NC40ads_H100_v5 | 71400 | 37.4 | 37.3 | 37.2 | 0.1 |
| 138602 | 37.4 | 37.1 | 36.9 | 0.3 | ||
| 191185 | 37.9 | 37.5 | 37.2 | 0.4 | ||
| 662665 | 37.1 | 37.0 | 36.8 | 0.1 | ||
| 13601264 | 37.2 | 37.1 | 37.0 | 0.1 | ||
| Standard_NC6s_v3 | 71400 | 115.8 | 108.9 | 104.1 | 6.2 | |
| 138602 | 108.9 | 107.0 | 105.7 | 1.7 | ||
| 191185 | 107.3 | 105.0 | 103.3 | 2.1 | ||
| 662665 | 127.5 | 112.9 | 105.5 | 12.7 | ||
| 13601264 | 104.2 | 103.6 | 103.2 | 0.5 | ||
| OVHcloud | H100-380 | 71400 | 200.6 | 200.0 | 198.9 | 1.0 |
| 138602 | 223.4 | 207.6 | 199.4 | 13.7 | ||
| 191185 | 202.4 | 202.0 | 201.5 | 0.4 | ||
| 662665 | 228.7 | 211.5 | 202.7 | 14.9 | ||
| 13601264 | 225.6 | 216.7 | 200.4 | 14.1 | ||
| L4-90 | 71400 | 50.1 | 49.3 | 48.3 | 0.9 | |
| 138602 | 49.6 | 49.5 | 49.2 | 0.3 | ||
| 191185 | 49.7 | 48.9 | 47.8 | 1.0 | ||
| 662665 | 50.0 | 49.3 | 48.9 | 0.6 | ||
| 13601264 | 49.0 | 48.5 | 48.0 | 0.5 | ||
| L40S-90 | 71400 | 51.2 | 50.9 | 50.3 | 0.3 | |
| 138602 | 52.8 | 51.2 | 50.5 | 0.8 | ||
| 191185 | 51.7 | 51.2 | 50.4 | 0.5 | ||
| 662665 | 52.6 | 51.4 | 50.7 | 0.8 | ||
| 13601264 | 50.7 | 49.9 | 49.5 | 0.4 | ||
| T1-LE-45 | 71400 | 129.1 | 121.7 | 114.7 | 7.2 | |
| 138602 | 110.3 | 109.6 | 108.6 | 0.9 | ||
| 191185 | 117.1 | 114.1 | 111.9 | 2.7 | ||
| 662665 | 109.8 | 108.1 | 106.0 | 1.9 | ||
| 13601264 | 113.6 | 109.2 | 105.2 | 4.2 | ||