Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Data Importing from cassandra to solr

Hello Friends, I want to know by any way we can use solr data import handler with cassandra. If I can get any reference site or example would be good help.

Thanks

like image 970
Manojak Avatar asked Nov 03 '22 04:11

Manojak


People also ask

What is full-import and Delta-import in SOLR?

In other words, a full-import will execute exactly 1 query for each defined entity + N queries for each sub-entity, while a delta-import will execute 1 query to get given entity's changed elements list + N queries for each changed element + another N queries for each defined sub-entity.

How do I import data into Cassandra?

After executing above cqlsh query the line prompt changes to [copy] let's have a look. Starting copy of cluster1. Data with columns [id, firstname, lastname]. Now, insert the row value of table which you want to import.

What is Delta-import in SOLR?

delta-import. For incremental imports and change detection. Only the SqlEntityProcessor supports delta imports. For example: http://localhost:8983/solr/dih/dataimport?command=delta-import . This command supports the same clean , commit , optimize and debug parameters as full-import command described below.

What is dih in SOLR?

The Data Import Handler (DIH) provides a mechanism for importing content from a data store and indexing it. In addition to relational databases, DIH can index content from HTTP based data sources such as RSS and ATOM feeds, e-mail repositories, and structured XML where an XPath processor is used to generate fields.


2 Answers

I'd have a look at datastax's page on cassandra integration with solr. Also look at this Github repository, its a library for cassandra and solr.

like image 97
Lyuben Todorov Avatar answered Nov 10 '22 15:11

Lyuben Todorov


That gitHub library is old , only Datastax Enterprise uses the integration of Cassandra with Solr, but its not free.

You can see Stargate-core soluton for cassandra but it uses lucene Another one is Stratio Cassandra again it used Lucene

Hope this helps

Regards Asit

like image 39
asitkaushik Avatar answered Nov 10 '22 15:11

asitkaushik