OVHcloud GPU benchmark - LlaVa
Go back to list| eval_count_mean | eval_rate_mean | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| model | llava | llava:13b | llava:13b-v1.6-vicuna-q8_0 | llava:34b | llava:34b-v1.6-q8_0 | llava:7b-v1.6-mistral-q8_0 | llava | llava:13b | llava:13b-v1.6-vicuna-q8_0 | llava:34b | llava:34b-v1.6-q8_0 | llava:7b-v1.6-mistral-q8_0 | ||
| provider_name | flavor_name | flavor__gpu_model | ||||||||||||
| Amazon Web Services | g5.xlarge | NVIDIA A10G | 72.000 | 74.000 | 92.667 | 95.917 | 92.000 | 78.468 | 47.888 | 30.177 | 21.006 | 51.518 | ||
| p3.2xlarge | Tesla V100-SXM2-16GB | 73.000 | 63.125 | 87.667 | 85.167 | 102.687 | 67.589 | 20.319 | 71.446 | |||||
| Google Cloud | a2-highgpu-1g | NVIDIA A100-SXM4-40GB | 80.667 | 82.667 | 97.000 | 117.567 | 81.016 | 38.250 | ||||||
| a2-ultragpu-1g | NVIDIA A100-SXM4-80GB | 82.261 | 83.792 | 94.750 | 126.470 | 87.103 | 42.525 | |||||||
| g2-standard-16 | NVIDIA L4 | 87.333 | 101.333 | 97.667 | 49.961 | 27.921 | 11.715 | |||||||
| n1-highmem-8 Intel Skylake Tesla V100 | Tesla V100-SXM2-16GB | 87.333 | 91.000 | 84.786 | 82.923 | 104.618 | 67.999 | 22.047 | 72.743 | |||||
| Microsoft Azure | Standard_NC40ads_H100_v5 | NVIDIA H100 NVL | 108.000 | 128.000 | 99.692 | 120.000 | 75.667 | 79.000 | 188.615 | 129.355 | 103.871 | 65.704 | 45.540 | 158.181 |
| Standard_NC6s_v3 | Tesla V100-PCIE-16GB | 87.333 | 91.000 | 51.853 | 38.179 | |||||||||
| OVHcloud | H100-380 | NVIDIA H100 PCIe | 90.225 | 78.947 | 82.333 | 120.966 | 85.046 | 55.378 | ||||||
| L4-90 | NVIDIA L4 | 87.333 | 101.333 | 96.833 | 97.667 | 95.667 | 51.931 | 28.691 | 16.663 | 12.058 | 30.220 | |||
| L40S-90 | NVIDIA L40S | 94.105 | 106.261 | 98.857 | 80.091 | 85.857 | 86.923 | 122.442 | 71.789 | 43.420 | 31.316 | 17.934 | 75.705 | |
| T1-45 | Tesla V100-PCIE-16GB | 87.667 | 85.286 | 20.808 | 71.191 | |||||||||
| T1-LE-45 | Tesla V100-PCIE-16GB | 87.333 | 91.000 | 99.917 | 65.651 | |||||||||