Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How does the Viola-Jones face detection method work?

Tags:

Please explain to me, in few words, how the Viola-Jones face detection method works.

like image 892
BlackShadow Avatar asked Apr 27 '11 17:04

BlackShadow


People also ask

How does the Viola-Jones algorithm work?

Detection The Viola-Jones algorithm first detects the face on the grayscale image and then finds the location on the colored image. Viola-Jones outlines a box (as you can see on the right) and searches for a face within the box. It is essentially searching for these haar-like features, which will be explained later.

How does a face detection program work?

Facial recognition uses computer-generated filters to transform face images into numerical expressions that can be compared to determine their similarity. These filters are usually generated by using deep “learning,” which uses artificial neural networks to process data.

How many important steps are used in Viola-Jones algorithm to detect the objects?

The Viola-Jones algorithm has 4 main steps, and you'll learn more about each of them in the sections that follow: Selecting Haar-like features. Creating an integral image. Running AdaBoost training.

Is Viola-Jones a deep learning algorithm?

Our mobile cameras are often equipped with such technology where we can see a box around the faces. Although there are quite advanced face detection algorithms, especially with the introduction of deep learning, the introduction of viola jones algorithm in 2001 was a breakthrough in this field.


2 Answers

The Viola-Jones detector is a strong, binary classifier build of several weak detectors

Each weak detector is an extremely simple binary classifier 

During the learning stage, a cascade of weak detectors is trained so as to gain the desired hit rate / miss rate (or precision / recall) using Adaboost To detect objects, the original image is partitioned in several rectangular patches, each of which is submitted to the cascade

If a rectangular image patch passes through all of the cascade stages, then it is classified as “positive” The process is repeated at different scales

enter image description here

Actually, at a low level, the basic component of an object detector is just something required to say if a certain sub-region of the original image contains an istance of the object of interest or not. That is what a binary classifier does.

The basic, weak classifier is based on a very simple visual feature (those kind of features are often referred to as “Haar-like features”)
enter image description here

Haar-like features consist of a class of local features that are calculated by subtracting the sum of a subregion of the feature from the sum of the remaining region of the feature.

enter image description here
These feature are characterised by the fact that they are easy to calculate and with the use of an integral image, very efficient to calculate.

Lienhart introduced an extended set of twisted Haar-like feature (see image)

enter image description here
These are the standard Haar-like feature that have been twisted by 45 degrees. Lienhart did not originally make use of the twisted checker board Haar-like feature (x2y2) since the diagonal elements that they represent can be simply represented using twisted features, however it is clear that a twisted version of this feature can also be implemented and used.

These twisted Haar-like features can also be fast and efficiently calculated using an integral image that has been twisted 45 degrees. The only implementation issue is that the twisted features must be rounded to integer values so that they are aligned with pixel boundaries. This process is similar to the rounding used when scaling a Haar-like feature for larger or smaller windows, however one difference is that for a 45 degrees twisted feature, the integer number of pixels used for the height and width of the feature mean that the diagonal coordinates of the pixel will be always on the same diagonal set of pixels

enter image description here
This means that the number of different sized 45 degrees twisted features available is significantly reduced as compared to the standard vertically and horizontally aligned features.

So we have something like: enter image description here

About the formula, the Fast computation of Haar-like features using integral images looks like:

enter image description here

Finally, here is a c++ implementation which uses ViolaJones.h by Ivan Kusalic

to see the complete c++ project go here

like image 59
edgarmtze Avatar answered Sep 28 '22 09:09

edgarmtze


The Viola-Jones detector is a strong binary classifier build of several weak detectors. Each weak detector is an extremely simple binary classifier

The detection consists of below parts:

Haar Filter: extract features from image to calssify(features act to encode ad-hoc domain knowledge)

Integral Image: allows for very fast feature evaluation

Cascade Classifier: A cascade classifier consists of multiple stages of filters, to classify a image( sliding window of a image) is a face.

Below is an overview of how to detect a face in image.

enter image description here

A detection window shifts around the whole image extract feature(by haar filter computed by Integral Image then send the extracted feature to Cascade Classifier to classify if it is a face). The sliding window shifts pixel-by-pixel. Each time the window shifts, the image region within the window will go through the cascade classifier.

Haar Filter: You can understand the the filter can extract features like eyes, bridge of the nose and so on.

enter image description here

Integral Image: allows for very fast feature evaluation

enter image description here

Cascade Classifier:

A cascade classifier consists of multiple stages of filters, as shown in the figure below. Each time the sliding window shifts, the new region within the sliding window will go through the cascade classifier stage-by-stage. If the input region fails to pass the threshold of a stage, the cascade classifier will immediately reject the region as a face. If a region pass all stages successfully, it will be classified as a candidate of face, which may be refined by further processing.

enter image description here

For more details:

Firstly, I suggest you to read the source paper Rapid Object Detection using a Boosted Cascade of Simple Features to have a overview understanding of the method.

If you can't understand it clearly, you can see Viola-Jones Face Detection or Implementing the Viola-Jones Face Detection Algorithm or Study of Viola-Jones Real Time Face Detector for more details.

Here is a python code Python implementation of the face detection algorithm by Paul Viola and Michael J. Jones.

matlab code here .

like image 45
Jayhello Avatar answered Sep 28 '22 08:09

Jayhello