Sdk 4.1 on jetson agx orin jp 6.0

Question - did any one try running yolov8 sample on SVO? I recorded and exported SVO2 file, which worked well. However when attempting to execute the object detection custom detection with inputting the SVO2 I’m getting a blank screen with no errors, and program exits after what seems to me a completion reading the SVO file.

Notes:

  1. using zed2i camera input instead of the svo2 file works as expected.
  2. exporting avi file from the recorded svo file works as expected.

Hi @izidorg
this is weird because the SVO and the Live input should not have differences.
Please try to open the SVO in ZED Depth Viewer and check that it works as expected.
Please also be sure that when using the SVO as input you set the InitParameter svo_real_time_mode to true if you want the file to keep the real-time frequency.

Hi @Myzhar ,

FYI,
the svo file ran seccessfully with ZED Depth Viewer.
the default seetting of svo_real_time_mode is true.
I’m attaching the screenshoot of the cli command.

Pleas also note, the size of the svo file is: 1950528888 bytes.

Hi @izidorg,

Can you monitor the RAM usage while running the sample with the SVO?

Hi @mattrouss,

Please find the logg file. The log was started prior and finished after running the following command line:
python detector.py --weights yolov8m.pt --img_size 512 --conf_thres 0.1 --svo hodaya.svo2
logg (81.2 KB)

Hi @izidorg,

To the looks of the log file, this does not seem like a RAM issue or a memory leak.

Can you please try another sample from the zed-sdk repository, both in Python and in C++, to validate the SVO2 file works with SDK samples?

Hi @mattrouss,
I’m nor sure of this is good enough… I used the SVO file as input to the tools/Depth Viewer, which worked fine.

In addition I’ve tested the spatial mapping cpp and python.
CPP:
/usr/local/zed/samples/spatial mapping/spatial mapping/cpp/build/ZED_Spatial_Mapping hodaya.svo2 > log.txt
using some additional commands: w,d,l.
the log.txt is too big to upload here, but most of it contains the following text on each lines:
[2024-07-14 06:29:08 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:11 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:15 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:18 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:22 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:25 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:29 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:33 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:36 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:40 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:43 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:47 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:50 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:54 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:29:58 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
[2024-07-14 06:30:01 UTC][ZED][WARNING] END OF SVO FILE REACHED in sl::ERROR_CODE sl::camera::grab(sl::RuntimeParameters)
the spatial mapping display has been opened and showed the right display but it didn’t change over the testing time (like freezing).

PYTHON:
for the CLI command: python spatial_mapping.py --input_svo_file hodaya.svo2, the application worked but completely ignored the svo file, showing only the camera input and proper mesh on top of the camera captures.

Note: the complete ignorance of the svo file was as well on the python depth sensing app.

Can you please verify my reporting findings on your hardware?

Hi @izidorg,

Thank you for reporting this, I am able to reproduce your issues on the spatial mapping sample.

For the python samples, this behavior happens because of a small filter on the arguments of the script.
On this line in the sample zed-sdk/spatial mapping/spatial mapping/python/spatial_mapping.py at master · stereolabs/zed-sdk · GitHub, you can change the endswith(".svo") with endswidth("svo2") and it should work as expected.

I am also able to reproduce the issue on the C++ sample, I logged this internally so that we can investigate further, but it seems related to the sample itself.

Thanks, I will check later today. :pray:

hi @mattrouss

I’ve tested again according yours recommendation, and I haven’t seen any change, so that the expected behaviour is still not there. Can you please record and playback the svo file in your setup, and if it will work okay is it possible to you to send me your link so I can clone it in my AGX Orin HW?