I am working on an interactive art installation that will use full body / hand tracking to manipulate the Unreal Engine built .exe file projected on a wall. I typically work with Blueprints in UE and have experience with livelink for face tracking with regular cameras. I imagine real time body/hand tracking should be similar with depth camera.
The work needs to let visitors manipulate projected scene (and objects in it) through different gestures ( arms / hands) and general body motion. ( moving objects around, activating sound, changing materials etc)
I am planning to use a three-projector setup with ~30 ft length of the combined projectors. I am considering purchasing one (or more) of ZED cameras to use for this project.
What would be your recommendation for the camera best suitable for this task?
Should I use a single camera for this? Is there a limit on the amount of tracked people?
What are the considerations I should be aware of?
Thank you very much, any input is very appreciated.
ZED 2i is stated to have up to 120 FOV - I would have to use the widest possible FOV to make sure that it works. The idea is to have a 3 projector setup on a ~30m long wall and create a touchless interaction with different virtual objects in the projection. so the distance of the audience from the projection surface will depend on the FOV. If it is too narrow that would not work for me as the audience would have to stand too far away. Ideally, they’d be 2-3 meters away from the surface. Camera would be placed above and in the center of the wall, so 15m from each side.
Does ZED have blueprint setup and gesture support? I would need a Blueprint-based way to access gesture data.