Use Media Source Extensions with raw video frames

Question

I'm trying to do live realtime streaming of H264 video from a server to the browser. The H264 stream is not wrapped inside a MP4 container, but instead it finds it's way to the browser (through web sockets) in the form of raw H264 frames.

The question is: Is it possible to feed the media source extensions with raw frames instead of a file container such as MP4 or WebM?

The mp4 solutions such as MPEG-DASH do not give me the flexibility that I need with regard to low latency, multiple video synchronization and other elements that I need to achieve.

Answer 1

MP4 boxing is required for MSE, and far too cumbersome to implement in a browser.

With raw h264, you can try to use Broadway, a h264 decoder (via emscripten) implementation for the browser.

See a real time example in my dedicated project https://github.com/131/h264-live-player