Menu
I'm using S3 select to query a object from a file in S3 bucket but wondering if I can do it with multiple files or if its limited to just one. I wrote one query from a file using aws lambda but when I tried writing another one for a different file it gave me a error message.
972
Athena can query multiple objects at once, while with S3 select, we can only query a single object (ex. a single flat file)
S3 provides unlimited scalability, and there is no official limit on the amount of data and number of objects you can store in an S3 bucket. The size limit for objects stored in a bucket is 5 TB.
With S3 Select, you simply store your data on S3 and query using SQL statements to filter the contents of S3 objects, retrieving only the data that you need. By retrieving only a subset of the data, customers reduce the amount of data that Amazon S3 transfers, which reduces the cost and latency of retrieving this data.
Upload multiple files to AWS CloudShell using Amazon S3. Next, you need to upload the files in a directory from your local machine to the bucket. You have two options for uploading files: AWS Management Console: Use drag-and-drop to upload files and folders to a bucket.
Amazon S3 Select operates on only one object.
To query multiple files at once on S3 with a SQL syntax you should use Amazon Athena.
108
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
