Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How do Mel Frequency Cepstrum Coefficients work?

I allready have FFT and pitch + absolute frequency calculated in real-time from input of microphone. Now I want to calculate the timbre.

I saw Mel Frequency Cepstrum Coefficients - MFCCs but I didn't understand it very well. Can someone give me some tips on this..

like image 721
André Avatar asked Oct 24 '09 22:10

André


People also ask

What is Mel Frequency Cepstral Coefficients used for?

MFCCs are commonly used as features in speech recognition systems, such as the systems which can automatically recognize numbers spoken into a telephone. MFCCs are also increasingly finding uses in music information retrieval applications such as genre classification, audio similarity measures, etc.

What is cepstrum frequency?

Cepstrum of speech segment. The most visually prominent feature in this cepstrum is the peak near quefrency 7 ms. It corresponds to a fundamental frequency of 1000/(7 s) = 143 Hz.

What is MFCC and how it works?

The MFCC feature extraction technique basically includes windowing the signal, applying the DFT, taking the log of the magnitude, and then warping the frequencies on a Mel scale, followed by applying the inverse DCT. The detailed description of various steps involved in the MFCC feature extraction is explained below.


1 Answers

MFCCs combine consideration of aspects of human hearing (logarithmic frequency perception, the mel scale) and physics of musical instruments (these systems often have well defined overtones that are harmonic -- which is why the MFCCs use the FFT of the FFT), to give a simplified representation of the timbre of an instrument (where the fundamental frequency and loudness are factored out).

One could write endless pages on this topic, and there are many available on the web, so a more specific question that explains clearly what you want to know would be helpful. The algorithm for calculating MFCCs is listed at the top of the wikipedia page.

like image 71
tom10 Avatar answered Oct 06 '22 13:10

tom10