Paper published on a website (Scientific congresses, symposiums and conference proceedings)
RANS: Highly-Parallelised Simulator for Reinforcement Learning based Autonomous Navigating Spacecrafts
EL HARIRY, Mhamed Matteo; RICHARD, Antoine; OLIVARES MENDEZ, Miguel Angel
202317th Symposium on Advanced Space Technologies in Robotics and Automation (ASTRA '23)
Peer reviewed
 

Files


Full Text
2310.07393v1.pdf
Author postprint (4.47 MB)
Download

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
Simulation; Spacecrafts; Reinforcement Learning; Trajectory Optimization.
Abstract :
[en] Nowadays, realistic simulation environments are essential to validate and build reliable robotic solutions. This is particularly true when using Reinforcement Learning (RL) based control policies. To this end, both robotics and RL developers need tools and workflows to create physically accurate simulations and synthetic datasets. Gazebo, MuJoCo, Webots, Pybullets or Isaac Sym are some of the many tools available to simulate robotic systems. Developing learning-based methods for space navigation is, due to the highly complex nature of the problem, an intensive data-driven process that requires highly parallelized simulations. When it comes to the control of spacecrafts, there is no easy to use simulation library designed for RL. We address this gap by harnessing the capabilities of NVIDIA Isaac Gym, where both physics simulation and the policy training reside on GPU. Building on this tool, we provide an open-source library enabling users to simulate thousands of parallel spacecrafts, that learn a set of maneuvering tasks, such as position, attitude, and velocity control. These tasks enable to validate complex space scenarios, such as trajectory optimization for landing, docking, rendezvous and more.
Disciplines :
Computer science
Author, co-author :
EL HARIRY, Mhamed Matteo ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
RICHARD, Antoine ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
OLIVARES MENDEZ, Miguel Angel ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Space Robotics
External co-authors :
yes
Language :
English
Title :
RANS: Highly-Parallelised Simulator for Reinforcement Learning based Autonomous Navigating Spacecrafts
Publication date :
2023
Event name :
17th Symposium on Advanced Space Technologies in Robotics and Automation (ASTRA '23)
Event organizer :
ESA ESTEC
Event date :
11/10/2023
By request :
Yes
Audience :
International
Peer reviewed :
Peer reviewed
Available on ORBilu :
since 10 December 2024

Statistics


Number of views
54 (2 by Unilu)
Number of downloads
51 (0 by Unilu)

Bibliography


Similar publications



Contact ORBilu