Displaying ZED2i Stereo Video as 3D on HoloLens 2: Is It Possible?

Software
1

Hi everyone,

I am currently working on a project where I aim to control a vessel using HoloLens 2. As part of this setup, I have mounted a ZED2i camera on the vessel and want to stream the video from the ZED2i to the HoloLens 2, with the goal of displaying it as a 3D video.

I am aware that ZED2i does not natively support pass-through for HoloLens 2, as mentioned in the documentation (it specifies support for Oculus Rift and HTC Vive). However, I’m exploring if it’s possible to achieve a similar 3D effect on HoloLens 2.

I streamed the stereo video feed from the ZED2i and created a camera in Unity with a Culling Mask set to “Nothing.” Without this camera, Unity shows “No camera rendering,” but with it, I can see the side-by-side video. Unfortunately, it does not appear as a stereoscopic 3D video. When I test with an Oculus device, the stereo video displays perfectly as a 3D video.

I wonder if there’s a way to achieve the same effect on HoloLens 2. Does anyone have experience with displaying ZED2i stereo video as a 3D feed on HoloLens 2?

I’m considering alternative technical approaches and am open to any suggestions or shared experiences. Your advice or insights would be greatly appreciated!

Thanks in advance!

2

Hi,

I’m not sure as I never tested it but is the hololens compatible with the OpenXR integration in Unity?

Because our plugin is,so It might be worth looking into that direction.

Best regards,