Hey @JPlou! 
I’m getting similar results using Neural mode in Unity.
In the video you can see the Depth Texture from the ZED_Rig_Mono->Camera_Left, and in the bottom custom shaders that get the depth texture from ZEDRenderingPlane->Depth and only display the elements between two ranges (1.37m and 1.47m in this very case).
The depth mode is set to Neural, and it’s capturing at HD1080 at 30FPS.
This kind of noise its really annoying, as I need to capture a small item (a ball that hits some targets in a wall), and if the targets are close to this, the game thinks the ball hit them.
Neural is the depth mode that give us the best results so far, as we saw with your help in this post two months ago https://community.stereolabs.com/t/depth-noise-on-zed2i/4861/9
Is there something else we can do to fix this?
Cheers!