Elasticsearch for indexing multiple databases

Question

I'm fairly new to Elasticsearch and I have tried to see if a answer to this questions exists already but could not find it. My question is, I have data in multiple datastores (Hadoop, cassandra, Oracle and maybe more in the future). I want to use Elasticsearch to index all of these datastores and create a "master index". Is this possible? Also would the processing of indexing "move" all my data into EC?

Answer 1

For hadoop data you can go for ES-Hadoop-Connector. Create an index with mappings before dumping data into Elastic Search and then use the same index for holding your data.

    Configuration conf = new Configuration();
    conf.set("es.nodes", "localhost:9200");
    conf.set("es.resource.write", "Index_Name/Document_Type");

Similarly for all the remaining sources use the same index as sink. for each source change the corresponding Document_Type with same index name. so that it will become master index of you entire data.