Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

WordNet, Query Expansion, Step by Step

I want to make a project about query expansion using WordNet,but it's hard to find step by step method to do it.

Based on this article, I should take the following steps (assuming a sentence as input to the program):

  1. Tokenization
  2. Tagging part of speech
  3. Stemming word
  4. Word sense disambiguation
  5. Semantic similarity between the two synsets (it still confusing)

...and then we can conclude that the word with larger score is the query expansion from the input. However, I'm still confused about how to perform each of these steps. Is there any source which covers these in more detail?

like image 286
Ahimsa Afrizal Avatar asked Nov 20 '25 07:11

Ahimsa Afrizal


1 Answers

Query Expansion is a huge field in itself under IR (Information Retrieval).

Also, WordNet is by itself huge, and so it is difficult to find single step-by-step directions. However, there are tons of very good resources. I got started with it by taking several web examples and trying them out myself.

Resources you will find useful in getting started.

  1. The wordnet site itself (with examples)
  2. The WordNet Wikipedia page
  3. Python Programming.net has a WordNet tutorial page
  4. Even if you don't know Python, I would highly recommend the O'Reilly book "Natural Language Processing with Python". It's website has TONS of examples to get you started.

Hope that helps you get going.

like image 151
Ram Narasimhan Avatar answered Nov 25 '25 00:11

Ram Narasimhan



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!