Artificial Intelligence; eXtended Reality; Space Robotics; Extended reality; Immersive; Mission risk; Moon surface; Obstacles detection; Rover control; Scientific advances; South pole; Space robotics; Technological advances; Human-Computer Interaction; Media Technology; Modeling and Simulation
Résumé :
[en] Lunar exploration has become a key focus, driving scientific and technological advances. Ongoing missions are deploying rovers to the Moon's surface, targeting the far side and south pole. However, these terrains pose challenges, emphasizing the need for precise obstacles and resource detection to avoid mission risks. This work proposes a novel system that integrates eXtended Reality (XR) and Artificial Intelligence (AI) to teleoperate lunar rovers. It is capable of autonomously detecting rocks and recreating an immersive 3D virtual environment of the robot's location. This system has been validated in a lunar laboratory to observe its advantages over traditional 2D-based teleoperation approaches.
Disciplines :
Sciences informatiques
Auteur, co-auteur :
COLOMA CHACON, Sofia ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
FRANTZ, Alexandre ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
VAN DER MEER, Dave ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
SKRZYPCZYK, Ernest ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust > Space Robotics > Team Miguel Angel OLIVARES MENDEZ
ORSULA, Andrej ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
OLIVARES MENDEZ, Miguel Angel ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
Co-auteurs externes :
no
Langue du document :
Anglais
Titre :
Immersive Rover Control and Obstacle Detection based on Extended Reality and Artificial Intelligence
Date de publication/diffusion :
2024
Nom de la manifestation :
2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Lieu de la manifestation :
Orlando, Usa
Date de la manifestation :
16-03-2024 => 21-03-2024
Sur invitation :
Oui
Titre de l'ouvrage principal :
Proceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
Maison d'édition :
Institute of Electrical and Electronics Engineers Inc.
J. O. Burns, B. Mellinkoff, M. Spydell, T. Fong, D. A. Kring, W. D. Pratt, T. Cichan, and C. M. Edwards. Science on the lunar surface facilitated by low latency telerobotics from a lunar orbital platform-gateway. Acta Astronautica, 154: 195-203, 2019.
S. Coloma, C. Martinez, B. C. Yalcn, and M. A. Olivares-Mendez. Enhancing rover teleoperation on the moon with proprioceptive sensors and machine learning techniques. IEEE Robotics and Automation Letters, 7 (4): 11434-11441, 2022.
C. M. Edwards and T. Cichan. From the moon to mars base camp: An updated architecture that builds on artemis. In ASCEND 2021, p. 4137. 2021.
G. Jocher, A. Chaurasia, A. Stoken, J. Borovec, Y. Kwon, K. Michael, J. Fang, Z. Yifu, C. Wong, D. Montes, et al. ultralytics/yolov5: v7. 0-yolov5 sota realtime instance segmentation. Zenodo, 2022.
M. Labbé and F. Michaud. Rtab-map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and longterm online operation. Journal of field robotics, 36 (2): 416-446, 2019.
D. Schreckenghost, T. Fong, H. Utz, and T. Milam. Measuring robot performance in real-time for nasa robotic reconnaissance operations. In Proceedings of the 9th workshop on performance metrics for intelligent systems, pp. 194-202, 2009.
