Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to find synonyms based on word2vec

Tags:

word2vec

I 'm working on word2vec model using gensim in Python, but I found that the result are the words having the same theme, synonyms are only part of the result.

Can I find synonyms of a word based on the work I have done?

Any replies will be appreciated!

like image 699
Royan Avatar asked Jun 06 '17 09:06

Royan


People also ask

How Word2Vec find similar words?

Given a large corpus of text, word2vec produces an embedding vector associated with each word in the corpus. These embeddings are structured such that words with similar characteristics are in close proximity to one another.

Can we use the word Embeddings to find the synonyms?

However, using word embeddings alone poses problems for synonym extraction because it cannot determine whether the relation between words is synonymy or some other semantic relation.

How do you search for synonyms in word?

Click the word in your workbook that you want to look up. On the Review tab, click Thesaurus. To use one of the words in the list of results or to search for more words, do one of the following: To replace your selected word with one of the words from the list, point to it, click the down arrow, then click Insert.


1 Answers

Word2vec tends to indicate similar words – but as you've probably seen, the kind of similarity it learns includes more than just pure synonyms.

For example, word2vec similarities include words that appear in similar contexts, such as alternatives including even opposites. (After all, 'hot' and 'cold' are very similar words in many ways – both adjectives, primarily relating to temperature, and also figuratively used in the same sorts of non-temperature contexts. Only in their contrast are they antonyms.)

You'll likely need to use other techniques (perhaps in concert with word2vec) for pure-synonym discovery.

like image 168
gojomo Avatar answered Sep 24 '22 22:09

gojomo