Unity ZED plugin image capture performance

Software Unity
, ,
1

We are using ZED Mini cameras for a custom built AR headset. The application is built with the help of the Unity plugin and runs on Windows. We use the images of the ZED Mini cameras for passthrough. Generally it works.
The only issue we have is performance. We are aiming for at least 60 fps, which means we have a frame budget of 16 ms. The process of retrieving the image textures is already taking about 6 ms (with HD 720 resolution and the camera set to 60 fps), which means more than a third of the frame budget. As you can see in the screenshot, the call to dllz_retrieve_textures is the bottleneck.

grafik
grafik1160×166 25.1 KB

Do you see any chance to speed that up in your DLL function?

2

Which graphics API are you using? The current implementation might be a bit faster with DX11.

3

We currently use DX11.

4

I’m a bit surprised as it is very fast on my machine (with DX11).
Can you reproduce the issue with any of the example scenes of the project?

What’s your hardware?

5

Sorry, I forgot to mention that we have a dedicated hardware that the application runs on…
Processor: Intel Core I5-8500 3GHz
RAM: 16GB
Video: NVIDIA GeForce RTX 3050 (driver version 580.97)

If I run the application on my dev laptop, it takes about 3 ms…grafik

In-editor it runs much faster…

grafik
grafik1170×141 21.8 KB

7

We use a stereo setup with standard VR glasses and OpenXR support…

And we currently use SDK V 5.2.3…