Menu
I am looking for a good face, emotion and voice recognition method in C#. For face recognition I was early using Emgu CV which is not accurate and performance is very low in low light conditions. Also I need to find user's emotion. Whether sad or happy like that. But I found its not easy with Emgu CV.
Also for voice recognition I am not able to find any solutions yet, I found speech recognition but it is not what I need.
I don't want to use any online API's. Can anybody suggest me any SDKs or Algorithms using which I a implement face, emotion and voice recognition?
943
Kraus found that we are more accurate when we hear someone's voice than when we look only at their facial expressions, or see their face and hear their voice. In other words, you may be able to sense someone's emotional state even better over the phone than in person.
Facial Emotion Recognition (FER) is the technology that analyses facial expressions from both static images and videos in order to reveal information on one's emotional state.
Emotional AI can read people's feelings through text, voice tone, facial expressions, and gestures and adjust its demeanor accordingly. People have the upper hand in recognizing different emotions, but AI is catching up with its ability to analyze large volumes of data.
The emotions better recognized from the whole face were happiness, anger, and disgust, followed by fear; while surprise, neutral emotion, and sadness were more difficult to recognize.
Simply take a look at System.Speech.Recognition Namespace (look at this and this answer).
157
It seems that you need Kinect. http://www.microsoft.com/en-us/kinectforwindows/develop/
25
I understand the question is very old, although I would like to contribute to it since I am also working on similar application
For Face, Emotion and Voice recognition there are plenty available now, find below some options
1) Face detection and recognition using OpenCV: http://ahmedopeyemi.com/main/face-detection-and-recognition-in-c-using-emgucv-3-0-opencv-wrapper-part-1/
Pro: Open source so basically free. You can modify the code to accommodate your needs. Multiple platforms supported.
Con: Accuracy is tolerable but not great. This can be resolved by modifying the library to your needs.
2) Face detection and recognition with emotions: try Microsoft Cognition Service API
Pro: very accurate. It includes many other services such as NLP, Speech to Text, Text to Speech, Computer Vision, RT language translator and so on. Accuracy is great since the services are hosted on cloud and are being trained for every data input.
Con: Paid solution. Little expensive. You have to pay for each service separately.
3) Speech recognition: Google Voice API Pro: similar to MS cognition service. Accuracy is better in Noise. con: Paid. May not be good for one time sale commercial product
4) Speech recognition and NLP: wit.ai/api.ai Pro: Free to use. Can use data from other public apps. Accuracy is good. Con: I don't find find any
Try some more links as follows. May help a little.
MS Face API based security system https://www.hackster.io/peejster/facial-recognition-security-system-c6ca6c
20
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
