Streaming the ZED X One to web beside ROS 2 usage (RTSP or similar)

Hi,

In our product, we’re using a bunch of ZED X One 4k cameras (currently 4, but looking forward for more with the new SDK release) with the combination of Nvidia AGX Orin. The cameras are primarily used via your ROS 2 driver, however we’re looking for a way to also include the streams to a web interface beside the ROS. I know there’s a streaming feature in the ROS 2 driver that enables access to the cameras via ZED Explorer or ZED SDK itself, however that streaming seems to be using RTP protocol and therefore cannot be used in a way as if it would be with RTSP. We are considering also using the GStreamer to make the stream available as RTSP and then potentially get it back to ROS with some general drivers, however this doesn’t seem to be that handy.
My question therefore is, how do you think this could be done in the best way? Is the ROS 2 driver with streaming enabled and integrating it to the website using SDK the way to go, or could it be somehow converted to RTSP and make the integration to web easier?

All suggestions welcome!

you could use of the ZED HUB functionality which could stream zed to there platform and maybe use the webrtc functionality to push it forward to your own platform. but the streaming part of this is broken for a couple of months now. I am pushing them to get it fixed, but no reaction of when this would be fixed.
So I think you should search for other solutions.

I am also open for solutions to stream zed video feed to web interface.

Thank you for the answer. I didn’t know the ZED Hub before and will check it, however it seems that this feature is not directly available with the ROS 2 driver and I would probably need to manually modify the code to potentially add it.

@fgrcar GStreamer is always a valid solution in this case, even if I agree that the learning curve can be steep.

You can also consider using third-party ROS 2 nodes that subscribe to image topics and create an RTPS stream like this:

Do you think it’s possible to stream AR-passthrough through unity using the webrtc protocol for remote viewing on a headset, such as quest 3?

Thanks for the suggestion. We’ll give it a try.