I am wondering if it is possible to cat a gzip file stored on amazon s3. Maybe using some streamming client. What do you think?
We are loking for a operation similar to zcat s3://bucket_name/your_file | grep "log_id"
Found this thread today, and liked Keith's answer. Fast forward to today's aws cli it's done with:
aws s3 cp s3://some-bucket/some-file.bz2 - | bzcat -c | mysql -uroot some_db
Might save someone else a tiny bit of time.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With