State of the art of Public Object Storage Europe - Big Data


Big its low cost, its simplicity of usage and its high scability, Object Storage has become the de-facto storage solution. From a compute perspective, data are always remote and before a downloading step is required. In this scenario, we evaluate the main bottleneck: the download bandwidth

Context

  • 3x 5GB random binary files are uploaded into a single bucket
  • Each file is sequentially downloaded without multipart

No specific technic is used to download the files. A large chunk of 5GB is handled in 1 HTTP connection with tolerance to errors.

Output

  • Bandwidth: Average download speed in MB per seconds
  • Errors: Number of errors, maximum 3