Menu
I have developed a cloud storage system that uses the same API structure as Amazon S3. Now I want to run some performance tests on getting object data and object metadata. In such a way that I can compare my system with Amazon S3, OpenStack storage and other systems.
I have looked at some common file system benchmark tools, there is too much work to convert them for Cloud Storage systems.
I am looking for some benchmark tools similar to SIEGE, that not only can performance http requests, but also have some workload simulation features. For example, one simulation can be storing an entire static HTML website in the Cloud Storage then performance some workload stress test etc.
Can someone help and suggest some existing framework or tools that can be relatively easy to be fit for such cloud storage system benchmark scenario?
205
To optimize performance, we recommend that you access the bucket from Amazon EC2 instances in the same AWS Region when possible. This helps reduce network latency and data transfer costs. For more information about data transfer costs, see Amazon S3 Pricing .
Amazon S3 is an object storage service that stores data as objects within buckets. An object is a file and any metadata that describes the file. A bucket is a container for objects. To store your data in Amazon S3, you first create a bucket and specify a bucket name and AWS Region.
To find the size of a single S3 bucket, you can use the S3 console and select the bucket you wish to view. Under Metrics, there's a graph that shows the total number of bytes stored over time.
Amazon S3 has various features you can use to organize and manage your data in ways that support specific use cases, enable cost efficiencies, enforce security, and meet compliance requirements. Data is stored as objects within resources called “buckets”, and a single object can be up to 5 terabytes in size.
You can probably look into COSBench, which is a tool to benchmark object storage cloud services.
194
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
