I have around 300 million text files, ranging from 50kb to 100kb that I need to read and serve on a web page.
Remarks:
On Azure Table, I would need to split some of the text files, to make sure it doesn't exceed the maximum of 64kb per column.
On Azure Blob, I would not have the problem of splitting, but would need to store a reference to them on the Azure SQL/Azure Table.
Okay, intro is done! Now, on my Azure Web App:
I agree with Andrei M. The best solution is blob storage with a table service or even a sql database to store reference.
Just one more thing, if you plan to search for content in those file, neither table service / blob will be good for that. If that's the case, I recommend you setup a VM with elastic search / solr and index those contents.
PS: there's also Azure Search, for that, you can give it a try too.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With