passing real-time metadata synchronized with video frames using webrtc and text tracks

Question

I'm using WebRTC (win c++ native client) to broadcast real-time video to peers (hosted in Chrome).
Goal: send metadata along each video frame (metadata changes at frame level).

1. Would it be possible to send the metadata within a text track to be consumed by a javascript at the peer side?
   
2. If not, is there an alternative way of synchronizing WebRTC real-time video with metadata?
   e.g., using WebRTC DataChannel / WebSockets?

Answer 1

I guess you need this features

https://webrtc.googlesource.com/src/+/77c8e65b88c9d2d95442b66ada504e0f1c553d66

Update multiplex encoder to support having augmenting data attached to the video