# Zed-unity plugin - stereo rendering - AR passthrough for Quest 3

**URL:** <https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544>\
**Category:** Unity\
**Created:** [April 6, 2025, 3:52pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544 "2025-04-06T15:52:03Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 6, 2025, 3:52pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/1 "2025-04-06T15:52:03Z")

</div>

Good day! We have set up a unity project to create an AR passthrough for oculus quest 3. We select the stream from the zed x mini camera as the source. Open XR provider - all settings for oculus quest have been completed. There are no errors when starting the scene and building the project. But only the left camera is displayed in the editor scene, and we see the same thing in oculus quest 3 when launching the app. The image is fed to one eye from the left camera and AR passthrough, respectively, does not work. We have tried many options for project settings - the result remains the same. Please help me solve this problem. You don’t have to talk about the software versions right away - we tried it on different versions - it’s all the same. We have:  
Windows 10, Unity 6 (latest release), zed sdk 5, zed-unity plugin 5, Open XR plugin, cuda 12.  
When selecting the svo file as the video data source, the same thing happens.

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [April 7, 2025, 7:58am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/2 "2025-04-07T07:58:49Z")

</div>

Hi,

Only the left image is expected to be seen in the editor, not in the headset.  
Is the right eye black or do you also see the left image?

[Stereolabs](https://www.stereolabs.com/) Support

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 8, 2025, 12:27am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/3 "2025-04-08T00:27:54Z")

</div>

The right eye is black in the headset

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [April 8, 2025, 6:26am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/4 "2025-04-08T06:26:05Z")

</div>

Hi,

In the OpenXR settings, can you change the render mode from single pass to multipass? I remember it caused similar issues quite some time ago.

[Stereolabs](https://www.stereolabs.com/) Support

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 8, 2025, 2:06pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/5 "2025-04-08T14:06:46Z")

</div>

Yes, we tried multipass mode, the problem remains the same.

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 9, 2025, 6:25pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/6 "2025-04-09T18:25:39Z")

</div>

Is it possible to consult with the developer of the zed-unity plugin?

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [April 10, 2025, 2:08pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/7 "2025-04-10T14:08:04Z")

</div>

Yes sure, I worked myself on the plugin 🙂

[Stereolabs](https://www.stereolabs.com/) Support

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 12, 2025, 7:46pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/9 "2025-04-12T19:46:06Z")

</div>

Excellent 🙂 Have you checked how the plug-in works with the quest 3 and open xr headsets? Where can I see the code that performs stereo rendering? Could there be a mistake in the code that causes a problem with feeding stereo to both eyes in the headset? Could this code, designed for older oculus rift headsets, cause problems when working with quest 3? If so, could you adapt the plug-in code for the new headsets and open xr? Can you tell me what corrections need to be made in the code?

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [April 14, 2025, 6:40am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/10 "2025-04-14T06:40:25Z")

</div>

We do not have a Quest3 headset at the office. It has only been tested with several HTC Vive headsets and the Quest and Quest 2 headsets.

Even though the issue may be coming from the plugin, I’d be surprised if he issue only happens with the Quest 3 specifically, but everything is possible.

Could you give me your OpenXR version? I’ll try to replicate the issue with your exact setup.

[Stereolabs](https://www.stereolabs.com/) Support

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 14, 2025, 9:08pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/12 "2025-04-14T21:08:51Z")

</div>

I understand that the problem is still in the plugin, since we tried the unity template MR project without zed and it is displayed normally in the headset after assembly. Below is our developer’s comment:  
"Dear ZED SDK Team,  
We are developing a Mixed Reality application in Unity and have been following your official guide: Build Your First AR/MR App with Unity.​ [Build your first AR/MR App with Unity - Stereolabs](https://www.stereolabs.com/docs/unity/creating-mixed-reality-app)

Setup Details:  
Unity Version: 6000.0.44f1​  
OpenXR Plugin: 1.14.2​

ZED SDK: 5.0.0

We’re using the built-in renderer pipeline

Here’s a link to the google drive link to download our Unity project: [SVO Test 2.zip - Google Drive](https://drive.google.com/file/d/1Xclq4dxD4KmU_Jg562OlXX3jJucJNfGL/view?usp=sharing)

Issue: After following the setup instructions, we successfully achieved image rendering in the left eye with metadata and everything. However, the right eye only displays the camera’s solid color background, with no video feed.​ Basically stereo rig doesn’t work, it renders only the left eye, which is weird. We’ve made sure to use multipass and all the correct settings.

Additionally, in the Unity Editor, we encounter the following error:​  
transform.localPosition assign attempt for ‘Frame’ is not valid. Input localPosition is (Infinity, -Infinity, 0.0150000)

Troubleshooting Steps Taken:

- Tried a workaround with ZEDMixedRealityPlugin.cs apart from the basic instructions provided here since they don’t work for us: [Build your first AR/MR App with Unity - Stereolabs](https://www.stereolabs.com/docs/unity/creating-mixed-reality-app)
- Ensured all required references in ZEDMixedRealityPlugin.cs are properly assigned, including ZEDManager, eye cameras, screen quads, FinalCameraCenter, and QuadCenter.​
- Modified the plugin to bypass the RenderTexture.IsCreated() check, replacing it with a null-check to accommodate stream-mode initialization delays.​
- Confirmed that ZEDManager reports readiness, and RenderTextures for both eyes are present and assigned.​
- Tested both SVO playback and live Stream modes; the issue persists in both scenarios.​
- Observed that in SVO mode, the left eye displays the video feed correctly, while the right eye does not.​

We would appreciate any guidance on:  
Potential causes for the right eye failing to render.  
The significance and resolution of the ‘Frame’ transform error mentioned above.​

Thank you for your assistance!  
Best regards, [Your Name / Team Name]

[Stereolabs](https://www.stereolabs.com/) ([Build your first AR/MR App with Unity - Stereolabs](https://www.stereolabs.com/docs/unity/creating-mixed-reality-app))  
Build your first AR/MR App with Unity - [Stereolabs](https://www.stereolabs.com/)  
In this tutorial, you will learn how to create a simple mixed reality application."

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 17, 2025, 11:52am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/13 "2025-04-17T11:52:39Z")

</div>

Waiting for an answer. Please see my message above. Our project is stalled due to the fact that we do not yet understand whether your plugin works in principle with respect to the new oculus software.

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 21, 2025, 11:08am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/14 "2025-04-21T11:08:36Z")

</div>

Waiting for an answer

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 25, 2025, 12:18pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/15 "2025-04-25T12:18:02Z")

</div>

Waiting for an answer

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [April 28, 2025, 6:27am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/16 "2025-04-28T06:27:07Z")

</div>

Hi,

Sorry for the late reply,

Can you try the latest version of the plugin? I fixed something related to the right camera calibration that might be causing your issue ([https://github.com/stereolabs/zed-unity/commit/e514617e68bf4ea6a1098f2b97617bbbea468e3b](https://github.com/stereolabs/zed-unity/commit/e514617e68bf4ea6a1098f2b97617bbbea468e3b)).

[Stereolabs](https://www.stereolabs.com/) Support

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 29, 2025, 2:22pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/17 "2025-04-29T14:22:26Z")

</div>

Hello, Benjamin

First of all, thank you for promptly fixing the right-eye render issue in the Zed Camera plugin—everything now displays correctly and without artifacts.

However, we’ve run into another concern: when moving objects (for example, hands) left or right of the screen center, the fingers and hands become excessively stretched horizontally, whereas the same objects appear noticeably squashed near the center. In other words, the plugin seems to over-scale the image horizontally, distorting object proportions.

To troubleshoot, we have tried:

- Switching the Stream resolution from 1920 × 1080 to 2134 × 1200
- Toggling between different Depth Modes (performance, quality, ultra etc.)
- Setting Depth Submission Mode to “Depth 24 bit” instead of “None” (we’re using OpenXR)

Unfortunately, none of these changes have alleviated the stretching.

Could you please clarify:

1. Is this behavior intentional in the current version, or is it a bug?
2. If it is a bug, do you have any recommendations for a workaround or plans to address it in a future update?

We’ve attached a fixed build that renders both eyes (SVO Test 0) for you to check. [https://drive.google.com/file/d/16jxt-ih7wED1c5dRnx3DBj26UFsb1YFj/view?usp=sharing](https://drive.google.com/file/d/16jxt-ih7wED1c5dRnx3DBj26UFsb1YFj/view?usp=sharing)

 ![Снимок экрана (30)](https://community.stereolabs.com/uploads/default/original/2X/e/e27c861189a9e2ffff1c16bc613e20c934a2372e.jpeg)  
 ![Снимок экрана (31)](https://community.stereolabs.com/uploads/default/original/2X/a/a31a017946e1b3ea2c6fb3ef1524176b569c2c55.jpeg)  
 ![Снимок экрана (32)](https://community.stereolabs.com/uploads/default/original/2X/1/1aabf73fa65f959ceebeb93710762b2436b6e26f.jpeg)  
 ![Снимок экрана (33)](https://community.stereolabs.com/uploads/default/original/2X/8/8f78f096a2015314bbac1b5eacb0e424bbadf6df.jpeg)

We really appreciate your time and effort on the Zed Camera plugin and look forward to any guidance you can provide.

Best regards, Maxim

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [April 29, 2025, 2:41pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/18 "2025-04-29T14:41:17Z")

</div>

Did you make any modifications regarding the “planes” where the images are displayed? The size, position or anything like that?

[Stereolabs](https://www.stereolabs.com/) Support

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [April 29, 2025, 4:10pm UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/19 "2025-04-29T16:10:47Z")

</div>

No, no changes were made.

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [May 1, 2025, 12:04am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/20 "2025-05-01T00:04:56Z")

</div>

The image from the zed x mini is equally distorted (enlarged and stretched) when using different depth modes as well as using the oculus provider. So it’s not about Open XR. For the sake of interest I tried to run the build with the old zed, via usb. There it turned out the opposite - the image is greatly reduced - the body of a dwarf 🙂

---

<div class="post-metadata">

**Author:** ![Mistikyork](https://community.stereolabs.com/user_avatar/community.stereolabs.com/mistikyork/32/2946_2.png) [@Mistikyork](https://community.stereolabs.com/u/Mistikyork)\
**Post date:** [May 1, 2025, 12:05am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/21 "2025-05-01T00:05:40Z")

</div>

> [@BenjaminV](#):
>
> Did you make any modifications regarding the “planes” where the images are displayed? The size, position or anything like that?
> 
> [Stereolabs](https://www.stereolabs.com/) Support

No, no changes were made.

---

<div class="post-metadata">

**Author:** ![BenjaminV](https://community.stereolabs.com/user_avatar/community.stereolabs.com/benjaminv/32/3863_2.png) [@BenjaminV](https://community.stereolabs.com/u/BenjaminV)\
**Post date:** [May 6, 2025, 6:58am UTC](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544/22 "2025-05-06T06:58:34Z")

</div>

I might be a resolution issue, as you suspected. For some reason, the plane where the image is displayed may have the wrong aspect ratio.  
Could you verify that?

[Stereolabs](https://www.stereolabs.com/) Support

[Next page](https://community.stereolabs.com/t/zed-unity-plugin-stereo-rendering-ar-passthrough-for-quest-3/8544.md?page=2)
