Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Support vector machines - separating hyperplane question

From what I've seen, seems like the separation hyperplane must be in the form

x.w + b = 0.

I don't get very well this notation. From what I understand, x.w is a inner product, so it's result will be a scalar. How can be it that you can represent a hyperplane by a scalar + b? I'm quite confused with this.

Also, even if it was x + b = 0, wouldn't it be of a hyperplane that passes right through the origin? From what I understand a separating hyperplane doesn't always pass through the origin!

like image 544
devoured elysium Avatar asked Oct 07 '09 09:10

devoured elysium


2 Answers

It is the equation of a (hyper)plane using a point and normal vector.
Think of the plane as the set of points P such that the vector passing from P0 to P is perpendicular to the normal

alt text

Check out these pages for explanation:

http://mathworld.wolfram.com/Plane.html
http://en.wikipedia.org/wiki/Plane_%28geometry%29#Definition_with_a_point_and_a_normal_vector

like image 52
Amro Avatar answered Nov 10 '22 02:11

Amro


Imagine a plane in a 3d coordinate system. To describe it, you need a normal vector N of that plane and the distance D of the plane to the origin. For simplicity, assume the normal vector has unit length. Then the equation for that plane is x.N - D = 0.

Explanation: x.N can be visualized as a projection of x on the normal vector N. The result is the length of vector x parallel to N. If this length equals D, the point x is on the plane.

like image 21
Niki Avatar answered Nov 10 '22 01:11

Niki