Fusion API support in Unity

Software Unity
1

Hi ZED team,
I am currently working with the ZED Unity Plugin for body tracking and would like to clarify whether Fusion-based multi-camera body tracking is supported (or planned) in Unity.

At the moment, the official body tracking tutorials and prefabs in the Unity plugin appear to be designed for single-camera (mono) setups. I could not find any examples or documentation related to using the Fusion API within the Unity workflow.

My target setup is the following:

(1) Use two or more ZED cameras
(2) Perform multi-camera calibration using ZED360
(3) Load the resulting calibration file into Unity
(4) Enable multiple cameras simultaneously
(5) Use Fusion API to fuse skeleton data and obtain a more accurate 3D avatar in Unity

This workflow seems feasible at the SDK level (Fusion API), but I am unclear about the Unity side.

Could you please advise:
Whether Fusion-based multi-camera body tracking is currently supported in the Unity plugin
If not, whether this is planned or recommended via a different workflow (e.g. external Fusion + streaming into Unity)
Thank you very much for your support.
Best regards,
Zizhuo

2

There is Unity Livelink Live Link for Unity sample - Stereolabs

But I can’t recommend it for customer projects atm. If you use RTX 5xxx cards and up its nearly impossible to use it in a reliable way because you need sdk version >5.x. If you are just use it for research or not critical things and have access to older upper class rtx cards (no 5xxx) then you can use it with small bugs (latest SDK Version 4.x).

I am waiting right now since >1 year for a SDK 5.x Version with usable Fusion for Unity. Needed to buy for a customer two rtx 4070 (one as spare part) for a successfull project goal…

3

Hi Tunkail,

Thank you very much for your feedback — that’s really helpful.

I’m currently using an RTX 5090 with the latest SDK (5.1.2), and I’m seeing the LiveLink running at a relatively low frame rate (around <20 FPS), which aligns with what you described.

That said, this is a research-focused project rather than a customer-delivered one. Thanks again for taking the time to share your experience — I really appreciate it.

Best regards,
Zizhuo

1 Like