OVHcloud GPU benchmark - Whisper FP16
Go back to list| fps | |||||||
|---|---|---|---|---|---|---|---|
| model | base | large | medium | small | tiny | ||
| provider_name | flavor_name | flavor__gpu_model | |||||
| Amazon Web Services | g5.xlarge | NVIDIA A10G | 2053.4 | 589.0 | 784.8 | 1350.1 | 2520.2 |
| p3.2xlarge | Tesla V100-SXM2-16GB | 1265.6 | 342.5 | 453.9 | 773.4 | 1567.2 | |
| Google Cloud | a2-highgpu-1g | NVIDIA A100-SXM4-40GB | 1696.4 | 491.6 | 649.3 | 1105.3 | 2064.5 |
| a2-ultragpu-1g | NVIDIA A100-SXM4-80GB | 1701.6 | 499.0 | 660.3 | 1128.3 | 2106.4 | |
| g2-standard-16 | NVIDIA L4 | 1648.0 | 454.1 | 612.4 | 1052.7 | 2071.7 | |
| n1-highmem-8 Intel Skylake Tesla V100 | Tesla V100-SXM2-16GB | 1849.0 | 517.0 | 699.2 | 1222.8 | 2225.9 | |
| Microsoft Azure | Standard_NC40ads_H100_v5 | NVIDIA H100 NVL | 3379.6 | 1009.7 | 1338.0 | 2224.7 | 4170.0 |
| Standard_NC6s_v3 | Tesla V100-PCIE-16GB | 1398.3 | 376.0 | 507.0 | 882.2 | 1743.0 | |
| Standard_NV36ads_A10_v5 | NVIDIA A10 | 2553.8 | 705.3 | 996.2 | 1698.0 | 3076.1 | |
| OVHcloud | H100-380 | NVIDIA H100 PCIe | 3265.2 | 997.3 | 1338.9 | 2213.7 | 3890.3 |
| L4-90 | NVIDIA L4 | 3318.3 | 647.3 | 1177.0 | 2158.1 | 4032.6 | |
| L40S-90 | NVIDIA L40S | 3391.2 | 1014.8 | 1370.4 | 2280.3 | 4055.6 | |
| T1-LE-45 | Tesla V100-PCIE-16GB | 1767.9 | 454.4 | 642.8 | 1138.4 | 2140.6 | |