I am trying to to use the body tracking on the Zed 2 in a scene with multiple subjects, but I notice that the performance of the program falls quickly with more people in the scene.
I am using the python body tracking example and create a millis() function to check how long it takes to go through the loop and here is are my findings:
1 person: 34-47ms 2 people: 47-48ms 3 people: 52-62ms 4 people: 63-76ms 5 people: 78-100ms
The plan is to pump some of this data into Unreal so ideally we want to sit at 41-42ms to reach a target data rate of 24 fps, and we plan to potentially have 10-20 people in a scene at once. Is there anything that can be done to prevent this behavior.
Here are the things we have already tried but have had little effect:
sl.DETECTION_MODEL. # all models sl.BODY_FORMAT. # both POSE_18 and POSE_34` detection_confidence_threshold = # 1-80 positional_tracking_parameters.set_as_static = # True and False
Also this is was tested on:
GPU: RTX 2060 and RTX 3090
RAM: 8GB and 64GB
Currently trying to do tests on:
CUDA: 11.7 + CUDNN
(but as of today 3.7.5 is only 2 days old and unstable)