Animate character using body tracking data in javascript (three.js, or any other 3D engine)

Hi there,

I’m using ZED2 for body tacking, and need to use the data to animate 3D characters in the browser.

I wonder if there are any library/standards that I could follow? Or any suggestion on how that could be done?

Beside, is BODY_38 an open standard, or is it something specific to the ZED SDK?

Thanks a lot!

Hi,

There is no universal standard for skeleton rigging to my knowledge but our skeleton is very close to what can be done by Mixamo (https://www.mixamo.com/).

Stereolabs Support

Hi, I’m trying to use the local_orientation_per_joint array to pose Mixamo 3D models in three.js.

At first I think it would be straight-forward, by comparing BODY_38 and Mixamo bone structure, and mapping IDs to bone names accordingly. This approach works for one model (but need to flip the rotation quaternion to [-x, y, -z, w]), but failed in different ways for other models. And all those models share the same bone hierarchy.

We tried to build our own rigs, but are very confused what works and what’s not. Some of our exports have twisted joints; and sometime the meshes are twisted terribly.

Btw we have tried all the Coordinate Systems and “RIGHT_HANDED_Y_UP” seems to be the least broken one for us.

Perhaps it is more of an 3D application issue than a ZED issue, but would someone here be able to provide some insight? We thought it might be related to bone rolling or difference in 3D world coordinate, but there’s so many variables we don’t know where to look into.

Thanks in advance!