Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Finding topics of an unseen document via Gensim

I am using Gensim to do some large-scale topic modeling. I am having difficulty understanding how to determine predicted topics for an unseen (non-indexed) document. For example: I have 25 million documents which I have converted to vectors in LSA (and LDA) space. I now want to figure out the topics of a new document, lets call it x.

According to the Gensim documentation, I can use:

topics = lsi[doc(x)]

where doc(x) is a function that converts x into a vector.

The problem is, however, that the above variable, topics, returns a vector. The vector is useful if I am comparing x to additional documents because it allows me to find the cosine similarity between them, but I am unable to actually return specific words that are associated with x itself.

Am I missing something, or does Gensim not have this capability?

Thank you,

EDIT

Larsmans has the answer.

I was able to show the topics by using:

for t in topics:
    print lsi.show_topics(t[0])
like image 971
Peter Kirby Avatar asked Jul 13 '12 13:07

Peter Kirby


1 Answers

The vector returned by [] on an LSI model is actually a list of (topic, weight) pairs. You can inspect a topic by means of the method LsiModel.show_topic

like image 111
Fred Foo Avatar answered Sep 22 '22 08:09

Fred Foo