Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Can k-means fall into an infinite loop ?

I've studied the k-means algorithm and I know how it works.

Just curious,is there any situation that this algorithm will go into an infinite loop,say if we have some particular bad choices for initial centroid points? I could only imagine a situation k-means will get to local minimum with bad initial choices.

like image 852
Kevin Avatar asked Nov 04 '10 23:11

Kevin


People also ask

Does K mean guaranteed to converge?

Yes. It converges but not coverage to the same result and not coverage with the same speed. It proves mathematically that the iterated running of finding the centers in k-means is converges.

Where k-means technique fail?

K-means fails because the objective function which it attempts to minimize measures the true clustering solution as worse than the manifestly poor solution shown here. The Euclidean distance entails that the average of the coordinates of data points in a cluster is the centroid of that cluster (algorithm line 15).

When Should k-means stop iterating?

There are essentially three stopping criteria that can be adopted to stop the K-means algorithm: Centroids of newly formed clusters do not change. Points remain in the same cluster. Maximum number of iterations are reached.

In what conditions k-means will not give optimal results?

K-means fails to find a good solution where MAP-DP succeeds; this is because K-means puts some of the outliers in a separate cluster, thus inappropriately using up one of the K = 3 clusters. This happens even if all the clusters are spherical, equal radii and well-separated.


1 Answers

No. k-means has an upper bound of O(nkd) in d-dimensional space.

like image 182
Jacob Avatar answered Sep 22 '22 05:09

Jacob