Menu
How can I access all frames in a video stream from the hololens camera, when in 3D mode? I'm using C#.
The unity VideoCapture class doesn't seem to provide this:
http://docs.unity3d.com/550/Documentation/ScriptReference/VR.WSA.WebCam.VideoCapture.html
and the microsoft MediaCapture class with method MediaCapture.StartPreviewToCustomSinkAsync is not very well documented.
https://msdn.microsoft.com/en-us/library/windows/desktop/ms701626(v=vs.85).aspx
350
If you're logged in with your personal Microsoft account, to access the photos and videos captured on HoloLens, download the OneDrive app from the Microsoft Store on your HoloLens. Once downloaded, open the OneDrive app and select Settings > Camera upload, and turn on Camera upload.
The current generation HoloLens (above) actually has 5 cameras – two on each side for depth sensing using infra-red dot emitters, much like the Kinect, and a centre RGB camera which uses regular ambient light for Simultaneous Localization and Mapping (SLAM), similar to how the cameras in Windows Mixed Reality headsets ...
HoloLens includes a world-facing camera mounted on the front of the device that enables apps to see what the user sees. Developers have access to and control of the camera, just as they would for color cameras on smartphones, portables, or desktops.
Voice to record videosOn HoloLens 2, version 2004 (and later), say: "Start recording." To stop recording, say "Stop recording." On HoloLens (1st gen) or HoloLens 2, version 1903, say: "Hey Cortana, start recording." To stop recording, say "Hey Cortana, stop recording."
We made an open source project called CameraStream to address this need. As a Unity plugin, it uses MediaCapture to feed the byte array into Unity (along with locatable matrices). From there you can assign the bytes to a Texture2D, as shown in the provided Unity example.
Our VideoCapture class mimic's Unity's class of the same name so that developers would be familiar with how to use it. We're also assuming that this functionality will be provided by Unity out-of-the-box eventually.
71
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
