Ollama benchmark Q2 2024 - Exoscale A40 - NVbandwidth
Go back to list| avg | ||||
|---|---|---|---|---|
| max | mean | min | std | |
| testcase | ||||
| device_to_host_bidirectional_memcpy_ce | 14.2 | 14.1 | 14.1 | 0.0 |
| device_to_host_memcpy_ce | 14.3 | 14.2 | 14.2 | 0.0 |
| device_to_host_memcpy_sm | 1.0 | 1.0 | 0.9 | 0.1 |
| host_to_device_bidirectional_memcpy_ce | 6.4 | 6.4 | 6.3 | 0.0 |
| host_to_device_memcpy_ce | 26.6 | 24.8 | 18.8 | 3.4 |
| host_to_device_memcpy_sm | 26.8 | 26.7 | 26.7 | 0.1 |