Distributed Platform for Immersive Orchestration of Mobile Robot Fleets (DIANE)
Funded by: The European Union through the SPIRIT project (101070672)
Call: SPIRIT Open Call 1
Project abstract
The DIANE project aims to develop a distributed immersive platform for teleoperating mobile robots equipped with stereo cameras. The operator will use a VR headset, such as the Meta Quest 3, to explore 3D scenes captured by the robot in real-time, transmitted as point clouds over a 5G network via WebRTC. The platform allows users to switch between multiple robots in remote locations using a Unity interface, offering two modes: teleoperation mode, where the operator directs the robot’s movement, and monitoring mode, where users observe and monitor the robot’s actions autonomously. Key innovative aspects include the use of real-time point clouds for enhanced visual feedback using WebRTC protocol for low-latency data transfer. The project will be demonstrated in real-world environments, connecting robots across different locations with the University of Surrey’s infrastructure, showcasing new levels of immersivity and control in teleoperation systems.
News
- Open Call Winner Interview: https://spirit-project.eu/2024/10/16/spirit-open-call-winners-interview-with-saverio-mascolo-from-quavlive-s-r-l
- Accepted paper at mmsys25: https://dl.acm.org/doi/abs/10.1145/3712676.3719263 (Best demo paper award 🏆)
- Accepted paper at EuroXR2025: https://link.springer.com/chapter/10.1007/978-3-032-03805-0_1
- Best demo poster award at EuroXR2025: https://doi.org/10.13140/rg.2.2.31670.77122 (Best demo paper award 🏆)
- Spirit-open-call1 videos: https://spirit-project.eu/open-call1-videos