Distributed Platform for Immersive Orchestration of Mobile Robot Fleets (DIANE)
Funded by: The European Union through the SPIRIT project (101070672)
Call: SPIRIT Open Call 1
Project abstract
The DIANE project aims to develop a distributed immersive platform for teleoperating mobile robots equipped with stereo cameras. The operator will use a VR headset, such as the Meta Quest 3, to explore 3D scenes captured by the robot in real-time, transmitted as point clouds over a 5G network via WebRTC. The platform allows users to switch between multiple robots in remote locations using a Unity interface, offering two modes: teleoperation mode, where the operator directs the robot’s movement, and monitoring mode, where users observe and monitor the robot’s actions autonomously. Key innovative aspects include the use of real-time point clouds for enhanced visual feedback using WebRTC protocol for low-latency data transfer. The project will be demonstrated in real-world environments, connecting robots across different locations with the University of Surrey’s infrastructure, showcasing new levels of immersivity and control in teleoperation systems.