Install NEURAL and other depth processing without network connection

Software
1

Hi all,

I am using a ZED 2 with a Seeed Studios ReComputer J3010 (basically an NVIDIA Jetson). The Jetson runs Ubuntu 20.04.5. For security reasons I am not allowed to connect the Jetson to the internet at all. I installed the ZED SDK for Jetpack 5.1.1 via USB stick, and thereafter installed all the dependencies needed to launch the Zed apps like explorer and depth viewer the same way.

While depth viewer launches, I immediately get the error “Failed to download model. NEURAL mode won’t be available”. As I understand it, depth viewer is trying to grab the image processing model from the internet, and cannot because the Jetson isn’t connected to the network. I am wondering if there is a way to get NEURAL and the other image processing models for depth and tracking via flash drive, so I can use these functionalities. Thanks for the help!

2

Hi,

  1. It’s not very straightforward, but you can install the same ZED SDK Version on a PC connected to the internet (it doesn’t have to have a nvidia GPU), or download a Docker image. You can skip the installation of the optional elements; you will only need the ZED Diagnostic tool.

Then run the tool with “-aid” option to download all the AI models for this ZED SDK Version.

$ ZED_Diagnostic -aid

On Linux the model will be in /usr/local/zed/resources/ you can transfer them on the Jetson. (On Windows C:/ProgramData/Stereolabs/resources/)

  1. Alternatively, you can use this script; the model URLs are hardcoded and are specific for a given ZED SDK version, currently 4.1/4.2: Download ZED SDK **4.1** models · GitHub

A few things to note:

  • Models can change between ZED SDK version, make sure it matches
  • Some older targets may have a fallback model for compatibility reasons; the SDK may still complain it can’t download it if the PC doesn’t have the restriction (typically older Jetpack with old TensorRT).
1 Like
3

Hi Aymeric,

Thanks for the help. I got the SDK for windows on a connected machine, and now I’m trying to run the diagnostic tool with that ‘-aid’ flag. I can get it to run from powershell without the flag, but when I include -aid, it just doesn’t run. I tried with and without quote marks. Perhaps there’s a different flag for windows vs linux systems?

4

Can you try with CMD and not PowerShell?

5

I just tried it, unfortunately it does the same thing. I also tried using the ‘start’ command instead, that opens a window but it immediately closes and nothing further happens. Once again if I leave out the -aid tag, the diagnostic tool opens without issue.

6

I have no issue when I do it on my side

image
image610×227 4.28 KB

Are you on Windows 10 or 11 ? I don’t think it matters but who knows?

1 Like
7

Fascinating… I’m on Windows 11 enterprise. Do you think it could be because I don’t have CUDA or a graphics card?

8

Yes I’m sorry about that, turns out in the current version you need CUDA even to download models, not directly in the tool but in the underlying libs.

Which version of the ZED SDK are you using ? I’ll update the script. We’ll also improve this part for future version

9

Gotcha, I kinda figured that might be an issue. I’m going to request my organization for approval to install CUDA, once I’ve got that I’ll try the process again.

10

So, I got the correct version of CUDA installed, but the same problem is happening. Nothing launches, just get a new line in the terminal. This is a weird problem…

11

Hi @aba
What’s the model of the GPU installed on the PC?

12

There isn’t one, just crappy intel UHD graphics. The first reply in this thread stated that the system doesn’t need a GPU to download these files, but perhaps that’s not the case.

13

Let me know for which ZED SDK version you need the models (and if it’s only NEURAL or all), I’ll give you the direct links. It’s the fastest solution for now.

Otherwise, in the next patch, we’ll lift this GPU requirement for Diagnostic Tool model download and may also include NEURAL models in the installer.

14

I am using ZED SDK for JetPack 5.1.1 (L4T 35.3). NEURAL is the first model that Depth Viewer complains about not having, but I’d like to have all of them if possible. Thanks so much for all the help with this! I hope y’all are able to include the models in the install phase, it will make life easier for those working in environments with stricter security policies.

15

Thanks! Here are the current models URLs:

Alternatively download and run this python script, it’s equivalent, just easier to use; Download ZED SDK models · GitHub

1 Like
16

Thanks so much for the models! I put them in the requisite directory, and Depth Viewer is no longer upset about missing models. However, Depth Viewer is still not working, this time because it can’t find a calibration file for the camera. After doing some reading, it sounds like Depth Viewer also tries to download a calibration from the internet. I tried using the calibration tool to calibrate the camera myself, but although the app starts, the actual calibration routine never starts. It just gives me the blank checkered screen, and the moving circles don’t show up.

Sorry to keep bothering you with these issues, but I have to imagine there aren’t too many more boxes to check off before its working. I can provide my camera’s serial number if that will be needed to get the factory calibration file.

17

Hi @aba
Here you can read more about the calibration file and how you can retrieve it manually from our server if the host device is not connected to the internet:

18

Got it, depth viewer is working now! Thanks so much for all the help.

1 Like