Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How can I transfer data from an EBS volume to a S3 bucket?

I have about 400 GB data on an Amazon EBS volume and I need this data in a S3 bucket for Hadoop EMR usage.

How can I move/copy data from an EBS volume to a S3 bucket (both S3 bucket and EBS volume are in the same AWS region)?

Thanks

like image 506
CoreCoder Avatar asked Jul 10 '14 09:07

CoreCoder


People also ask

How do I transfer files to S3 bucket?

To upload folders and files to an S3 bucketSign in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/ . In the Buckets list, choose the name of the bucket that you want to upload your folders or files to. Choose Upload.

Can I move EBS snapshot to S3?

Upon the creation of an EBS snapshot, the data stored within the EBS volume(s) is automatically transferred to an Amazon S3 bucket for long-term storage purposes. This provides an easy-to-use, cost-efficient storage option for EBS backup data.


1 Answers

Firstly get your credentials at AWS via IAM:

Go to AWS/Services/IAM select Users and create an Administrator. After that, download your credentials.csv and run in shell:

aws configure

Enter your Access key ID and Secret access key.

Then copy files and folders from EBS in EC2 to S3:

aws s3 sync /ebs-directory/ s3://your-bucket​
like image 161
razimbres Avatar answered Sep 21 '22 13:09

razimbres