Menu
My Amazon S3 bucket has a folder structure that looks like the below.
If I only know file name file3.doc and bucket name bucket-name how can i search for file3.doc in bucket-name. If I knew, it is in folder 00002, I could simply go to the folder and start typing the file name but I have no way to know in which folder the file I am searching for is under.
755
Amazon S3 Select and Amazon S3 Glacier Select enable customers to run structured query language SQL queries directly on data stored in S3 and Amazon S3 Glacier. With S3 Select, you simply store your data on S3 and query using SQL statements to filter the contents of S3 objects, retrieving only the data that you need.
With the method "endsWith("/")" you can detect if the S3ObjectSummary is a folder or not. Hope this can helps someone. works like wonders!
For S3 on Outposts, your data is stored in your Outpost on-premises environment, unless you manually choose to transfer it to an AWS Region.
You can easily do this with the AWS CLI.
aws s3 ls s3://BUCKET-NAME/ --recursive | grep FILE-NAME.TXT
Using only the AWS CLI, you can run a list-objects against the bucket with the --query parameter. This will not be a fast operation, as it runs locally after fetching the file list, rather than inside s3's api.
$ aws s3api list-objects --bucket bucket-name --query "Contents[?contains(Key, 'file3')]"
[
{
"LastModified": "2017-05-31T20:36:28.000Z",
"ETag": "\"b861daa5cc3775f38519f5de6566cbe7\"",
"StorageClass": "STANDARD",
"Key": "00002/file3.doc",
"Owner": {
"DisplayName": "owner",
"ID": "123"
},
"Size": 27032
}
]
The benefit of using --query over just piping to grep is that you'll get the full response including all available metadata usually included in list-objects, without having to monkey around with before and after arguments for the grep.
See this post on Finding Files in S3 for further information including a similar example which shows the benefit of having metadata, when files of the same name end up in different directories.
33
You'll probably need to use a command line tool like s3cmd if you don't know where it is at all:
s3cmd --recursive ls s3://mybucket | grep "file3"
but some limited search is possible:
https://stackoverflow.com/a/21836343/562557
31
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
