Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to suggest (autocomplete) next word in elastic search?

Lets say I have following strings indexed:

"My awesome pizza"
"My awesome beer"
"Heineken is awesome beer"
"I love pizza pepperoni"
"Where is my beer"

For input "My" I want to suggest:

  1. My awesome
  2. My beer

For input "awesome" I want to suggest:

  1. awesome pizza
  2. awesome beer

etc.

So I want to provide next words after user input... Also with some fuzziness (aEwsome) should be also supported.

Which suggesters/analyzers I should use? I tried Term and completion but it is not what I want (completion for example works only when search for start of the phrase - if I pass word that is in the middle of indexed string then it will not suggest it,)

like image 980
user606521 Avatar asked Jul 15 '14 20:07

user606521


2 Answers

Just in case anyone bumps in here, the edge-n-gram approach (as noted by @Siddardha Budige) is now superseded by completion suggesters.

They are purposely built with auto-completion in mind, so they are fast end efficient. A very informative post By the ES team can be found here.

Two caveats:

  1. They are implemented by an in-memory Data-Structure (called a Finite State Transducer) and are therefore not suitable for large datasets that can't fit in memory.

  2. The ranking of the results is not based on similarity (a result either matches or not) so you have to be careful with blending fuzzy and non-fuzzy matches.

EDIT: We shared our own experience with using Completion Suggesters here.

It includes some practical examples on fuzzyness and info for non-English inputs.

like image 153
cmantas Avatar answered Oct 03 '22 23:10

cmantas


Elasticsearch provides a convenient way to get autocomplete up and running quickly with its completion suggester feature.

Check this link, this is what you are looking for

https://qbox.io/blog/multi-field-partial-word-autocomplete-in-elasticsearch-using-ngrams

Completion Suggester also helps you to achieve this functionality

like image 25
Siddardha Budige Avatar answered Oct 04 '22 00:10

Siddardha Budige