I have packages stored in s3 bucket. I need to read metadata file of each package and pass the metadata to program. I used boto3.resource('s3')
to read these files in python. The code took few minutes to run. While if I use aws cli sync
, it downloads these metafiles much faster than boto. My guess was that if I do not download and just read the meta files, it should be faster. But it isn't the case. Is it safe to say that aws cli is faster than using boto?
The AWS Command-Line Interface (CLI) actually uses boto itself, so it is not 'faster'.
However, the aws s3 sync
command uses threading to copy multiple files simultaneously, so the copy operation takes less elapsed time.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With