Finger detection on body tracking

Software Unity
,
1

Hello Stereolabs community,

I need to detect when a user open and closes their hand using the body tracking.

The docs for body tracking show that BODY_38 format has keypoints for thumbs, index, middle and pinky fingers.
https://www.stereolabs.com/docs/body-tracking#how-it-works

I recorded a video and used the BodyTrackingSingle example scene to test this, but I don’t see any movement in the fingers that are supposed to move.

Is there something I’m missing here?

I’m attaching the video with the test, and the configuration in the ZedManager

image
image619×323 12.7 KB

Thanks a lot

2

Hi @R2R0
Finger keypoints with the shape BODY_38 are primarily designed to help estimate hand orientation.
The accuracy is not sufficient to estimate precise finger movements.

3

Thanks @Myzhar

Is there any other way to detect when a person closes their hand?

I need an input to trigger certain behaviours and hand gestures would be the best ones.

Eg: Close a dialog input when the user closes their hand, as if it were “press A” in a videogame

4

You must use an external library to detect hand gestures.