Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Find cosine similarity between two arrays

I'm wondering if there is a built in function in R that can find the cosine similarity (or cosine distance) between two arrays?

Currently, I implemented my own function, but I can't help but think that R should already come with one.

like image 440
defoo Avatar asked Mar 29 '10 00:03

defoo


People also ask

How do you find cosine similarity with Numpy?

Using numpy. array()function we will create x & y arrays of the same length. In the above code, we import numpy package to use dot() and norm() functions to calculate Cosine Similarity in python. Using dot(x, y)/(norm(x)*norm(y)) , we calculate the cosine similarity between two vectors x & y in python.

How do you find cosine similarity in Python?

We use the below formula to compute the cosine similarity. where A and B are vectors: A.B is dot product of A and B: It is computed as sum of element-wise product of A and B. ||A|| is L2 norm of A: It is computed as square root of the sum of squares of elements of the vector A.

What is the cosine similarity between the below two vectors?

Cosine similarity measures the similarity between two vectors of an inner product space. It is measured by the cosine of the angle between two vectors and determines whether two vectors are pointing in roughly the same direction. It is often used to measure document similarity in text analysis.


1 Answers

These sort of questions come up all the time (for me--and as evidenced by the r-tagged SO question list--others as well):

is there a function, either in R core or in any R Package, that does x? and if so,

where can i find it among the +2000 R Packages in CRAN?

short answer: give the sos package a try when these sort of questions come up

One of the earlier answers gave cosine along with a link to its help page. This is probably exactly what the OP wants. When you look at the linked-to page you see that this function is in the lsa package.

But how would you find this function if you didn't already know which Package to look for it in?

you can always try the standard R help functions (">" below just means the R command line):

> ?<some_name>  > ??<some_name>  > *apropos*<some_name> 

if these fail, then install & load the sos package, then

***findFn*** 

findFn is also aliased to "???", though i don't often use that because i don't think you can pass in arguments other than the function name

for the question here, try this:

> library(sos)  > findFn("cosine", maxPages=2, sortby="MaxScore") 

The additional arguments passed in ("maxPages=2" and "sortby="MaxScore") just limits the number of results returned, and specifies how the results are ranked, respectively--ie, "find a function named 'cosine' or that has the term 'cosine' in the function description, only return two pages of results, and order them by descending relevance score"

The findFn call above returns a data frame with nine columns and the results as rows--rendered as HTML.

Scanning the last column, Description and Link, item (row) 21 you find:

Cosine Measures (Matrices)

this text is also a link; clicking on it takes you to the help page for that function in the Package which contains that function--in other words

using findFn, you can pretty quickly find the function you want even though you have no idea which Package it's in

like image 136
doug Avatar answered Oct 03 '22 16:10

doug