Dear Community,
I have 2 questions for ZED2 image, using SDK 4.1. :
is there an easy way how to retrieve image without wide lens distortion ?
As you can see in the image below, the image is stretched towards corners. I’d like to have a corrected image even if it would mean slightly narrower FOV.
In the depth image, there are artifacts when arms are close to body, but not touching it. Yet the camera shows them as connected object. Is there any way how to improve the detection? I am using the neural depth mode. See the image below where the space between arms is connected into one area together with the head.
This has been improved with Neural+ mode, but some artifacts remain and rendering speed is much slower.
The images displayed in ZED_Depth_Viewer are already rectified, so there should not be any distortion. How are you measuring that you have lens distortion? To verify this, you can check that all straight lines in real life are indeed straight in the image (we usually use for e.g. a calibration checkerboard target in different areas of the image for this). If this is not the case, the camera may be not correctly calibrated, and you can use the ZED_Calibration tool to recalibrate the camera
The issue of determining precisely the edges of objects is definitely a tricky one in stereo-vision. The performance of the depth algorithms can greatly vary depending on the texture and distance to the objects. In your case here, Neural is not precise enough to distinguish your arms from the rest of your body at that distance.
What I can suggest is to use the “Confidence” value in the Runtime parameters in ZED_Depth_Viewer, which can filter out values in which the algorithm is not confident in. This can help in most cases to remove the “unconfident” borders which most likely contain errors.
The distortion is usually present when wide lens is employed. The objects tend to stretch towards image corners (on the provided image example the leg and the arm are stretched). The problem has been addressed in this paper for example: Distortion-Free Wide-Angle Portraits on Camera Phones
Is there any way how the SDK could compensate for this distortion? Or is it possible to use a lens with smaller field of view on the ZED2 camera (or replace the lens)?
