Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

WebRTC - disable all audio processing

Tags:

I'm currently trying to get a clean as possible audio channel via webrtc. Via the getUserMedia mediaconstraints object, I've set the following options:

constraints: {         audio: {             mandatory: {                 echoCancellation: false,                 googEchoCancellation: false,                 googAutoGainControl: false,                 googAutoGainControl2: false,                 googNoiseSuppression: false,                 googHighpassFilter: false,                 googTypingNoiseDetection: false,                 //googAudioMirroring: false // For some reason setting googAudioMirroring causes a navigator.getUserMedia error:  NavigatorUserMediaError             }         },         video: false     }, 

This greatly improves the audio quality, but there still seems to be audio processing present which causes the mutilation of the audio in the form of high frequency noise with some of the test samples.

There is a Chrome flag --use-file-for-fake-audio-capture as described at http://peter.sh/experiments/chromium-command-line-switches/#use-file-for-fake-audio-capture which allows input via file for testing. As mentioned in the description of the flag, all audio processing has to be disabled or the audio will be distorted - so there seems to be additional options for this purpose.

I also tried the --disable-audio-track-processing --audio-buffer-size=16 --enable-exclusive-audio Chrome flags, but still there seems to be some audio processing.

Is there any way to disable the still present audio processing (preferably via JS API)?

like image 352
wowpatrick Avatar asked Apr 29 '15 06:04

wowpatrick


2 Answers

I'd wager that the variable bitrate (default) behavior of the opus codec is causing some compression or adjustment. You could manually mangle the SDP offer to use CBR (constant bitrate) instead of VBR (variable bit rate). When you get the SDP offer from the browser, change the line:

a=fmtp:111 minptime=10; useinbandfec=1 

to:

a=fmtp:111 minptime=10; cbr=1 

Note that I'm both adding cbr=1 and removing useinbandfec=1. I'm not positive that dropping useinbandfec is necessary, but it seems that in-band FEC (forwarding error correction) causes compression adjustment which you'd want to avoid as well.

like image 95
xdumaine Avatar answered Nov 15 '22 11:11

xdumaine


This is the updated way to disable audio processing and get a clean signal:

navigator.mediaDevices.getUserMedia({   audio: {     autoGainControl: false,     channelCount: 2,     echoCancellation: false,     latency: 0,     noiseSuppression: false,     sampleRate: 48000,     sampleSize: 16,     volume: 1.0   } }); 

If you are streaming audio via WebRTC, it defaults to radio or phone quality audio optimized for voice. So make sure your SDP has stereo and maxaveragebitrate params:

a=fmtp:111 minptime=10;useinbandfec=1; stereo=1; maxaveragebitrate=510000 
like image 33
Kim T Avatar answered Nov 15 '22 13:11

Kim T