Hi Zed team,
I am facing one issue with zed unity integration, currently i am using zed SDK 4.0, zedunityplugin 4.0.1, whenever i am using my camera(zed2) with zed_rig_stereo it is giving the white screen.
Also I am using, Ubuntu 20.04 in dell g15, rtx 3050
Hi,
I tried with the ZED SDK 4.0.3 and the Unity plugin 4.0.3 and it was working as expected.
Can you try upgrading your versions?
Hi,
I have already tried with that configuration you just said, but it always give me that white screen, anything else you can suggest, above you can see my, Laptop configuration.
@ BenjaminV
Hi, I am sharing my diagnostic report, also my Laptop configuration below.
Laptop configuration : OS - Ubuntu 20.04
Graphic card: RTX 3050
Laptop-Dell G15 Ryzen edition.
kernel - 5.15.0-75-generic
"Diagnostic report
{
“AI Models”: {
“info”: [
“MULTI CLASS DETECTION is not optimized”,
“MULTI CLASS MEDIUM DETECTION is not optimized”,
“MULTI CLASS ACCURATE DETECTION is not optimized”,
“HUMAN BODY FAST DETECTION is not optimized”,
“HUMAN BODY MEDIUM DETECTION is not optimized”,
“HUMAN BODY ACCURATE DETECTION is not optimized”,
“PERSON HEAD DETECTION is not optimized”,
“PERSON HEAD ACCURATE DETECTION is not optimized”,
“REID ASSOCIATION is not optimized”,
“NEURAL DEPTH is not optimized”
]
},
“Camera Test”: {
“InternalDevicesCount”: 2,
“ZEDCount”: 1,
“camera”: {
“Device ID”: 0,
“Firmware”: 1523,
“Init Output”: “OK”,
“Model”: “ZED 2”,
“Serial Number”: 23713965,
“valid”: [
“Camera: ZED 2”,
“Firmware: 1523”
]
},
“resolutions”: {
“HD1080@15”: {
“fps (input)”: 15,
“fps (output)”: 15,
“height (input)”: 1080,
“height (output)”: 1080,
“initialization”: “OK”,
“status”: true,
“width (input)”: 1920,
“width (output)”: 1920
},
“HD1080@30”: {
“fps (input)”: 30,
“fps (output)”: 30,
“height (input)”: 1080,
“height (output)”: 1080,
“initialization”: “OK”,
“status”: true,
“width (input)”: 1920,
“width (output)”: 1920
},
“HD2K@15”: {
“fps (input)”: 15,
“fps (output)”: 15,
“height (input)”: 1242,
“height (output)”: 1242,
“initialization”: “OK”,
“status”: true,
“width (input)”: 2208,
“width (output)”: 2208
},
“HD720@15”: {
“fps (input)”: 15,
“fps (output)”: 15,
“height (input)”: 720,
“height (output)”: 720,
“initialization”: “OK”,
“status”: true,
“width (input)”: 1280,
“width (output)”: 1280
},
“HD720@30”: {
“fps (input)”: 30,
“fps (output)”: 30,
“height (input)”: 720,
“height (output)”: 720,
“initialization”: “OK”,
“status”: true,
“width (input)”: 1280,
“width (output)”: 1280
},
“HD720@60”: {
“dropCount”: 0,
“fps (input)”: 60,
“fps (output)”: 60,
“height (input)”: 720,
“height (output)”: 720,
“imageCount”: 501,
“initialization”: “OK”,
“status”: true,
“tearingCount”: 0,
“width (input)”: 1280,
“width (output)”: 1280
},
“VGA@100”: {
“fps (input)”: 100,
“fps (output)”: 100,
“height (input)”: 376,
“height (output)”: 376,
“initialization”: “OK”,
“status”: true,
“width (input)”: 672,
“width (output)”: 672
},
“VGA@15”: {
“fps (input)”: 15,
“fps (output)”: 15,
“height (input)”: 376,
“height (output)”: 376,
“initialization”: “OK”,
“status”: true,
“width (input)”: 672,
“width (output)”: 672
},
“VGA@30”: {
“fps (input)”: 30,
“fps (output)”: 30,
“height (input)”: 376,
“height (output)”: 376,
“initialization”: “OK”,
“status”: true,
“width (input)”: 672,
“width (output)”: 672
},
“VGA@60”: {
“fps (input)”: 60,
“fps (output)”: 60,
“height (input)”: 376,
“height (output)”: 376,
“initialization”: “OK”,
“status”: true,
“width (input)”: 672,
“width (output)”: 672
}
},
“sensors”: {
“Firmware”: 776,
“Init Output”: “OK”,
“Model”: “ZED 2 (MCU)”,
“Serial Number”: 23713965
}
},
“Graphics Card”: {
“deviceCount”: 1,
“deviceDriverVersion”: 11070,
“devices”: [
{
“arch”: “Ampere”,
“computeCapability”: “8.6”,
“cores”: 2048,
“name”: “NVIDIA GeForce RTX 3050 Laptop GPU”,
“totalMemoryBytes”: “4100456448”,
“totalMemoryMB”: 3910.5
}
],
“initResult”: 0,
“valid”: [
“Graphics card: NVIDIA GeForce RTX 3050 Laptop GPU”
]
},
“Processor”: {
“OS”: “Ubuntu 20.04.6 LTS “,
“avxSupported”: true,
“coreCount”: “12”,
“cpu”: " AMD Ryzen 5 5600H with Radeon Graphics”,
“datetime”: “2023-06-27 09:10:43 AM IST”,
“hyperThreading”: “1”,
“motherboard”: “0TGD6F, Dell Inc.”,
“ramCapacity”: “16.075653”,
“ramUsage”: “”,
“ramUsed”: “15.888974”,
“threadCount”: “24”,
“valid”: [
“Processor: AMD Ryzen 5 5600H with Radeon Graphics”,
“Motherboard: 0TGD6F, Dell Inc.”
]
},
“USB”: {
“CorruptedFirmware”: false,
“MCUDetected”: true,
“USBList”: [
{
“USB_path”: “/1”,
“idProduct”: “0x0064”,
“idVendor”: “0x1ea7”
},
{
“USBMode”: 3,
“USB_path”: “/2”,
“bDescriptorType”: 1,
“bDeviceProtocol”: 1,
“bLength”: 18,
“bMaxPacketSize0”: 9,
“bNumConfigurations”: 1,
“bcdDevice”: “1.0”,
“bcdUSB”: “3.0”,
“bcdUSBClass”: 239,
“bcdUSBSubClass”: 2,
“busNumber”: 2,
“device”: “ZED2”,
“iManufacturer”: 1,
“iProduct”: 2,
“iSerial”: 0,
“idProduct”: “0xf780”,
“idVendor”: “0x2b03”
},
{
“USB_path”: “/4”,
“idProduct”: “0x6a09”,
“idVendor”: “0x0c45”
},
{
“USB_path”: “/3”,
“idProduct”: “0x0029”,
“idVendor”: “0x8087”
},
{
“USBMode”: 2,
“USB_path”: “/2/2”,
“bDescriptorType”: 1,
“bDeviceProtocol”: 0,
“bLength”: 18,
“bMaxPacketSize0”: 64,
“bNumConfigurations”: 1,
“bcdDevice”: “3.8”,
“bcdUSB”: “2.0”,
“bcdUSBClass”: 0,
“bcdUSBSubClass”: 0,
“busNumber”: 1,
“device”: “ZED2 MCU”,
“iManufacturer”: 1,
“iProduct”: 2,
“iSerial”: 3,
“idProduct”: “0xf781”,
“idVendor”: “0x2b03”
},
{
“USB_path”: “/2”,
“idProduct”: “0x2512”,
“idVendor”: “0x0424”
}
],
“USBMode”: 3,
“ZED Camera Module Detected”: 63360,
“ZED MCU Module Detected”: 63361,
“ZEDDetected”: true,
“valid”: [
“USB Bandwidth: OK”
]
},
“ZED SDK”: {
“CUDA Toolkit version”: “V11.7.99 -->located in /usr/local/cuda-11.7/bin/nvcc”,
“CUDA loading”: false,
“GPU Driver Version”: “Driver Version : 515.65.01”,
“GPU Performance”: " Performance State : P5”,
“ZED SDK Version (Diag)”: “3.8.2”,
“ZED SDK Version (RT)”: “3.8.2”,
“ai”: {
“checkAI”: true,
“cudaVersion”: 11070,
“cudnnCudartVersion”: 11060,
“cudnnVersion”: 8401,
“cudnnVersionExpected”: 8401,
“tensorVersion”: 8402
},
“binFiles”: [
“libsl_ai.so”,
“libsl_zed.so”
],
“resourcesFiles”: [
“skeleton_body38_3.5.model”
],
“resourcesFilesExpected”: [
“objects_performance_2.2”
],
“valid”: [
“ZED SDK version: 3.8.2”,
“CUDA version: V11.7.99”
]
}
}
Hi @gauravkhanduri,
It seems that the version of the SDK detected by ZED Diagnostic is 3.8.2. If that is the version on your computer, the Unity plugin should not even run.
It’s weird that you don’t have an error about this, though.
We just released a new version of the plugin that also fixes some issues with Ubuntu 20/22, and goes alongside ZED SDK v4.0.4.
Can you install this new SDK and plugin version and try it out?
Best,
Jean-Loup
Hi @JPlou
I have used the ZED sdk and zed plugin suggested by you, but after importing ZED plugin into unity it gives the prompt that zed sdk not found .
Hi @JPlou
Here is my new Laptop config(lenovo legion 5 pro, RTX 3070, AMD ryzen 6000 series).
I am currently using Cuda 12.1; ZED SDK 4.0.4; ZEDUNITY plugin 4.0.4.
no errors every this working fine but the zed always gives me the white screen after loading modules in unity. Please try to give me the good solution for my problem, or you can also try zed with same laptop configuration if available.
regards
Gourav.
Hi @gauravkhanduri ,
Can you try updating to SDK 4.0.5 with the corresponding Unity Plugin version that was just released? We updated the wrappers, which might fix your issue.
If it doesn’t, is it possible you try with CUDA 11.8?
To be clear, we are still investigating possible issues with the plugin on Ubuntu, and your input is valuable to us.
Sorry for the inconvenience,
Jean-Loup
Unity is working for me. I’m using:
Everything seems to be working fine. I did though have issues when trying to use a “3D (URP)” or “3D (HDRP)” Unity project type.
Maybe, try a Unity “3D Core” project.
Hi @JPlou
I have already tried with CUDA 11.8 with corresponding ZED sdk and zedunity plugin.
Just give me some practical example, try on some configuration which has less than RTX 3080 graphics with Ubuntu 20.
Hi @gauravkhanduri,
I (finally) tested on a bit of a lesser configuration (1070M), with Ubuntu 20 specifically, and could not reproduce your issue. I installed Unity, then created a 3D Core project, then imported the .unitypackage, and I could run the SimpleMR scene directly and have an image.
I encourage you to reinstall the last SDK (4.0.5), create a project and import the last version of the unity plugin (4.0.5 too). Please report if you still have issues with it afterwards.
Sorry for the inconvenience.
@JPlou I am attaching the screenshots , I am getting White screen , but zed camera is working , in object detection example , i can see bounding boxes, in white screen . This White Screen is the issue.
My Config : Zed SDK 4.0.5 Zed Unity Plugin 4.0.4 CUDA 11.8 GPU : RTX 3070 8GB
@gauravkhanduri Unity plugin 4.0.4 or 4.0.5? Please use v4.0.5 with SDK v4.0.5.
I think you mentioned CUDA 12.1 on one of your configs, can you try on it too?
Sorry but since I can’t reproduce your issue I have to ask you to test 
@JPlou @BenjaminV @Myzhar @obraun-sl There is some compatiblity issue with the camera , I have installed latest graphic driver with CUDA 12.2 and plugin is also 4.0.5 , still getting that white screen issue , the zed camera status shows camera is running , only problem is white screen and no actual photos.
@gauravkhanduri No need to tag the whole team, your ticket is followed. 
Do the other SDK function like Body Tracking work in Unity?
Does your ZED_Depth_Viewer tool work correctly?
Your setup changed a bit from the start, could you send a ZED_Diagnostic file again?
I have also encountered the same issue described by @gauravkhanduri and I would like to share my experience with you, perhaps it could be helpful. The peculiar thing is that it only occurred on some machines I had to work on. Specifically, with CUDA 11.8 and SDK version 4.0.5, I observed the following:
On the m15, I didn’t have any problems until I used SDK version 4.0.3. Once I updated, the issue appeared. On the problematic machines, I resolved it by uninstalling both CUDA and the SDK and then reinstalling everything with CUDA 12.1. However, I upgraded the SDK on the Aurora too and I had no issue in that case.
I always used the same Unity project, which is a 3D core one, no URP.
In my case as well, on the affected machines, the camera frame appeared gray both in the example scenes provided by the ZED plugin and in my own scenes. Additionally, the ZED Diagnostic tool did not detect any issues, and in the ZED Depth Viewer, I could consistently see both the video stream and the depth information for all resolutions and frame rates.
The problem is quite annoying, and I hope it gets resolved soon. Personally, I went to perform an installation for a client, thinking I had everything under control, but instead, I had to come up with a solution on the spot. Luckily, upgrading CUDA in my case was sufficient.
I hope my experience can be helpful. Feel free to ask if you need any further information.
I am having the same issue on Ubuntu 22.04. I am trying to use the 4.0.6 SDK with CUDA 12.1. The SDK is working fine, including the Python API. Diagnostics is coming back all green. However, when I import the unity package for 4.0.6 I get a message box saying the “ZED SDK is not installed” and none of the examples work. Any help or updates on this issue would be greatly appreciated.
Cheers,
Mike
Hi,
Can you try to go to Assets/ZED/SDK/Plugins/Linux, run the following command and share the output please ?
ldd libsl_unitywrapper.so
