Before purchasing the ZED X mini camera, I contacted support to inquire about the possibility of setting up a passthrough mode for the Oculus Quest 3 headset for our project. They informed me that it is possible and that relevant examples are available in the documentation. I used the guide at Build your first AR/MR App with Unity - Stereolabs to set up a basic scene with a video stream from the ZED X mini without any virtual objects. Firstly, Unity does not detect the camera stream, even though the stream works perfectly in the ZED SDK on my laptop. Secondly, an error occurs when launching the Oculus XR Plugin. The logs indicate that the Oculus Runtime driver is not installed: [XR] XR input Oculus failed to initialize OVR plugin. [Subsystems] Failed to initialize subsystem oculus input [error: 1] Unable to start Oculus XR Plugin. Possible causes include a headset not being attached, or the Oculus runtime is not installed or up to date. I tried combinations of different versions of Unity and ZED SDK, attempted connecting with an old ZED camera via USB, but nothing works. The Oculus Runtime is an old driver, and installing it causes a conflict with the new version of the Oculus app. How is this project supposed to work in this case? Could it be that the documentation guide is hopelessly outdated?
Hi,
First, let’s focus on the first issue, that you can not read the stream from your camera.
Could you tell me what ZED SDK version is installed on both the ZED Box and the computer where Unity is installed, please?
Stereolabs Support
zed sdk 4.2.1 - zed box, 4.2.3 - a laptop
and what is happening? It can’t connect to the stream at all? Do you get an error?
Stereolabs Support
In Unity, it simply won’t connect to the camera stream
That’s strange, I don’t have any issue receiving a stream from a ZED X Mini.
Do you have any log in the console window?
Stereolabs Support
Have you tried watching a stream in the zed sdk? The fact is that the laptop’s zed sdk sees my stream from the zed box. But in unity, a connection error is already occurring. From which I conclude that the problem is in some settings or in the zed-unity plugin.
In addition, I found out that we need to use the open xr, not the oculus xr for the oculus quest 3 helmet.
No, I tested to open the stream in Unity and it was working fine (with ZED SDK 4.2). I’m looking for what could be different in your case.
What version of the unity plugin are you using?
Stereolabs Support
I use unity 6. I tested the plugin yesterday with all types of incoming data. Streaming over a local wired network does not load at all and no errors pop up in the console. Videos from the file and the old zed via usb are opened in mono mode. Accordingly, the helmet does not see them. I tried to set up the project for Open XR. The error related to connecting the helmet has disappeared, but the link still won’t start…
In your screenshots, you never have the input set a stream, it’s either SVO or USB, is that normal?
Stereolabs Support
There are no messages in the console where I installed the incoming stream, so I didn’t make a screenshot. It just doesn’t load the video stream into the scene.