We are working on an interactive game that use a ZED 2i camera to track the player and the motion of it. For this particular interactive game, one requirement is that the player may be standing 5 to 6 meters away from the camera. We are starting to encounter some difficulties on getting correct player motion from the ZED 2i cameras.
To improve that, we are thinking if adding another ZED cameras will improve the depth detection or not? If multi-ZED cameras are supported for the unreal engine ZED plugin? Will the depth detection improve automatically by the plugin?
Or if there is any camera settings you can suggest to us to improve the preciseness of the depth detection would be greatly appreciated, thank you for your help in advance.
Unfortunately, it’s not possible to use several cameras managed by the UE5 plugin at the same time.
However, you should be able to use the ZED Live Link plugin inside of the ZED Samples project. This allows using the Fusion, which can bring you a more accurate skeleton in occlusion situations if multiple people are tracked or just by providing another point of view with higher confidence levels to the algorithm.
However, there is currently no solution to improve the depth with multiple cameras in the UE project, only the body tracking.
As for the camera settings for better depth accuracy, using a higher resolution and better depth mode (NEURAL_PLUS for instance) will help. You can also change the depth confidence threshold to keep the best values only.