using zed 2i with jetson nano and matlab

Hardware ZED2
,
1

Dear ZED Community,

I am working on my graduation project using the ZED 2i, Jetson Nano, and MATLAB. I want to connect the camera to the Jetson Nano and then transfer the data to MATLAB. I need the sensor data, depth data, and point cloud data, and I also need to recognize objects, possibly using YOLO.

Could someone guide me on how to transform this data? I have searched but am not entirely sure if the API will work with MATLAB or how to deal with the API on the Jetson Nano. Can someone point me in the right direction?

Thank you.

2

Hi @Ibrahimsh104,

I see that my colleague @JPlou has answered your same question on another post, I will copy it here so others can find:

[…] we have a Matlab interface documented here: How to Use Matlab with ZED - Stereolabs

That being said, it’s not compatible with streaming out-of-the-box.
I think the easiest way to make it so is to modify around this part of the code to call setFromStream() (similarly to the call to setFromSVOFile()).

3

i have read the Matlab interface documentations but I have issue with cmake i gives me error of cuda :

352302581-ff046fb3-7b2b-4b69-802a-14bdeb000abf
352302581-ff046fb3-7b2b-4b69-802a-14bdeb000abf1599×899 204 KB

i reinstalled cuda “CUDA Toolkit 12.5” multiple times and i notesed it gives me this message :
Installed:

  • Nsight for Visual Studio 2022
  • Nsight for Visual Studio 2019
  • Nsight Monitor
    Not Installed:
  • Nsight for Visual Studio 2017
    Reason: VS2017 was not found
  • Integrated Graphics Frame Debugger and Profiler
  • Integrated CUDA Profilers

i tried to solve it and installed nsight
NVIDIA Nsight Visual Studio Edition
NVIDIA Nsight Systems
NVIDIA Nsight Compute
NVIDIA Nsight Graphics
and video-codec-sdk bec. i noticed it is messing in the cmake environment and also not found at the location of cuda
how can i solve this problem?

4

Is there another way to transfer the data from the camera to MATLAB? Can I use an API to transfer this data? I would like to get the depth and point cloud data, as well as data from all the sensors. I have read your documentation about the API for each section, but I am not sure if this will work.

5

Hi @Ibrahimsh104,

This is currently the only way to stream data directly to Matlab live.

You could however record sensor data on the Jetson Nano in our proprietary SVO format, and open the file in Matlab for analyses.