State of the art of Public Object Storage Europe - Backup

Being off-server, Object Storage is the default solution to operate a data saving out of the compute infrastructure. In this scenario, we don't evaluate the Cold Storage solutions such as Glacier or Scaleway C14, unlike the Big Data scenario, we test the main bottleneck between compute and storage: the upload bandwidth.

Context

• 3x 5GB random binary files are uploaded into a single bucket with Multipart-upload
  • 32 threads
  • Multipart chunk size of 64MB

Multipart upload is used and each 5GB file is divided in 64MB chunk size and handled by a different HTTP connection without tolerance to errors.

Output

• Bandwidth: Average upload speed in MB per seconds
• Errors: Number of errors, maximum 3