Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Using ElasticSearch as a permanent storage

Recently I am working on a project which is producing a huge amount of data every day, in this project, there are two functionalities, one is storing data into Hbase for future analysis, and second one is pushing data into ElasticSearch for monitoring. As the data is huge, we should store data into two platforms(Hbase,Elasticsearch)! I have no experience in both of them. I want no know is it possible to use elasticsearch instead of hbase as a persistence storage for future analytics?

like image 351
Mehdi Alisoltani Avatar asked Nov 01 '25 15:11

Mehdi Alisoltani


1 Answers

I recommend you reading this old but still valid article : https://www.elastic.co/blog/found-elasticsearch-as-nosql Keep in mind, Elasticsearch is only a search engine. But it depends if your data are critical or if you can accept to lose some of them like non critical logs. If you don't want to use an additionnal database with huge large data, you probably can store them into files in something like HDFS.

like image 145
rnonnon Avatar answered Nov 04 '25 14:11

rnonnon



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!