OVHcloud GPU benchmark - Whisper FP32

Go back to list

fps
model base large medium small tiny
provider_name flavor_name flavor__gpu_model
Amazon Web Services g5.xlarge NVIDIA A10G 2509.7 713.1 984.1 1675.7 2946.9
p3.2xlarge Tesla V100-SXM2-16GB 1469.8 424.3 575.4 1009.6 1813.6
Google Cloud a2-highgpu-1g NVIDIA A100-SXM4-40GB 2048.2 601.6 801.1 1364.1 2412.3
a2-ultragpu-1g NVIDIA A100-SXM4-80GB 2059.1 607.0 807.2 1375.8 2463.8
g2-standard-16 NVIDIA L4 2015.7 533.3 749.9 1315.4 2417.4
n1-highmem-8 Intel Skylake Tesla V100 Tesla V100-SXM2-16GB 2190.6 657.5 884.1 1500.5 2575.4
Microsoft Azure Standard_NC40ads_H100_v5 NVIDIA H100 NVL 4266.5 1390.9 1857.2 3001.6 5085.8
Standard_NC6s_v3 Tesla V100-PCIE-16GB 1672.1 489.6 643.9 1081.8 1995.5
Standard_NV36ads_A10_v5 NVIDIA A10 3051.9 674.0 1122.1 2012.3 3563.0
OVHcloud H100-380 NVIDIA H100 PCIe 3903.3 1363.5 1841.5 3032.7 4470.1
L4-90 NVIDIA L4 4034.7 603.1 1096.3 2521.0 4777.2
L40S-90 NVIDIA L40S 4133.6 1233.2 1716.4 2803.7 4785.6
T1-LE-45 Tesla V100-PCIE-16GB 2048.2 612.3 809.2 1352.9 2390.7