Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Is there a way to dynamically update a synonym file without restarting Solr server?

As we know there is a synonym.txt file in conf directory, which I wanted to update whenever I found some new synonym words...

So is there any way to update that file dynamically without restarting the Solr server and will my search result consider the new synonym words??

please help me if anyone have any idea.. thanks in advance...

like image 937
milind_db Avatar asked Jul 19 '12 07:07

milind_db


2 Answers

I think you can build your own SynonymFilterFactory that extends the original and use your a custom FSTSynonymFilterFactory as delegator. your SynonymFilterFactory should extends the original SlowSynonymFilterFactory and call:

map = loadSolrSynonyms(loader, true, analyzer);

whenever you want to reload the synonym file.

For reloading your file when it changes you can use a watchdog thread that awke up every X time and check whether the sysnonim file was changed or you can use some file watcher to get notification when the file was changed.

like image 187
shem Avatar answered Sep 27 '22 21:09

shem


Solr provides Managed Synonym Graph Filter to manage synonyms using a REST API (in this example via /solr/collection_name/schema/analysis/synonyms/english endpoint):

<analyzer type="index">
    <tokenizer class="solr.StandardTokenizerFactory"/>
    <filter class="solr.ManagedSynonymGraphFilterFactory" managed="english"/>
    <filter class="solr.FlattenGraphFilterFactory"/> <!-- required on index analyzers after graph filters -->
</analyzer>
<analyzer type="query">
    <tokenizer class="solr.StandardTokenizerFactory"/>
    <filter class="solr.ManagedSynonymGraphFilterFactory" managed="english"/>
</analyzer>

A core reload is needed to apply synonyms changes. Solr provides a REST API for this too CoreAdmin API Reload admin/cores?action=RELOAD&core=core-name

The RELOAD action loads a new core from the configuration of an existing, registered Solr core. While the new core is initializing, the existing one will continue to handle requests. When the new Solr core is ready, it takes over and the old core is unloaded.

like image 29
heldev Avatar answered Sep 27 '22 21:09

heldev