Mobile Delivery Robots: Mixed Reality-Based Simulation Relying on ROS and Unity 3D

Published in Proceedings of 2020 IEEE Intelligent Vehicles Symposium (IV), 2020

Abstract: In the context of Intelligent Transportation Systems and the delivery of goods, new technology approaches need to be developed in order to cope with certain challenges that last mile delivery entails, such as navigation in an urban environment. Autonomous delivery robots can help overcome these challenges. We propose a method for performing mixed reality (MR) simulation with ROS-based robots using Unity, which synchronizes the real and virtual environment, and simultaneously uses the sensor information of the real robots to locate themselves and project them into the virtual environment, so that they can use their virtual doppelganger to perceive the virtual world. Using this method, real and virtual robots can perceive each other and the environment in which the other party is located, thereby enabling the exchange of information between virtual and real objects. Through this approach a more realistic and reliable simulation can be obtained. Results of the demonstrated use-cases verified the feasibility and efficiency as well as the stability of implementing MR using Unity for Robot Operating System (ROS)-based robots.

Access paper here or get the pdf here

Bibtex: download

@inproceedings{Liu2020,
  author    = {Yuzhou Liu and Georg Novotny and Nikita Smirnov and Walter Morales-Alvarez and Cristina Olaverri-Monreal},
  doi       = {10.1109/IV47402.2020.9304701},
  journal   = {IEEE Intelligent Vehicles Symposium, Proceedings},
  pages     = {15-20},
  publisher = {Institute of Electrical and Electronics Engineers Inc.},
  title     = {Mobile Delivery Robots: Mixed Reality-Based Simulation Relying on ROS and Unity 3D},
  year      = {2020}
}

Recommended citation: Liu, Y., Novotny, G., Smirnov, N., Morales-Alvarez, W., & Olaverri-Monreal, C. (2020). Mobile Delivery Robots: Mixed Reality-Based Simulation Relying on ROS and Unity 3D. IEEE Intelligent Vehicles Symposium, Proceedings, 15–20. https://doi.org/10.1109/IV47402.2020.9304701