Hand Eye Calibration Robot Arm

Hi Community,

is there any scipt or way to very precisely calibrate a ZED2i camera on a robot flange? I tried with 30 Positions on the robot arm but the distance to the camera is always false no matter which solver I take. I was using the OpenCV calibration with python functions. How can I test a better way?

Hi @becketps
We do not have specific tools for this type of calibration.

Have you tried to use the zed-aruco package to estimate the position of the camera with respect to the known position of an ArUco tag?

I am in Isaac Ros and there I have the April Tag detection running. I did not use that for calibration I only use there the checker board detection on the robot with cv2 because I have there a board with exact fields. But 5cm differences are not acceptable with any solver there no matter how much points I take

What positioning accuracy can be expected from the ZED2i in a robotic setup?

I am using a robot arm with an eye-in-hand configuration, where the camera is mounted on the end effector and observes an AprilTag at approximately a 90° viewing angle.

The system is based on the Universal Robots AI Accelerator (AI Accelerator for UR Cobots | Universal Robots
) and I am using the Isaac ROS AprilTag detection from your tutorial.

My AprilTagsI tested have sizes of 5 cm and 8 cm. The distance between the camera (left eye) and the tag is about 70–80 cm.

However, when I try to move the robot to the center of the detected tag, I consistently observe an error of about 2 cm in x, y, and z.

Is this level of accuracy expected for the ZED2i under these conditions?
And what would you recommend to improve the accuracy in this setup?