Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Streaming data to an object in S3

We have a input stream which need to be written to S3. This stream has large data and I cannot keep it in memory. We don't want to write to local disk and then transfer to S3 because of security reasons.

Is there a way to stream data to s3 object?

I think our problem can be solved using s3 multipart upload. But, that is used for different purpose - uploading large files. Instead is there a out of the box way to stream data to s3?

like image 677
kiran Avatar asked Jan 01 '26 08:01

kiran


1 Answers

This stream has large data and I cannot keep it in memory.

So multipart upload is the correct way to solve this.

like image 111
petertc Avatar answered Jan 05 '26 21:01

petertc



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!