Communication publiée dans un ouvrage (Colloques, congrès, conférences scientifiques et actes)
Human-Centric Aware UAV Trajectory Planning in Search and Rescue Missions Employing Multi-Objective Reinforcement Learning with AHP and Similarity-Based Experience Replay
RAMEZANI, Mahya; Atashgah, M.A.; SANCHEZ LOPEZ, Jose Luiset al.
2024 • In 2024 International Conference on Unmanned Aircraft Systems, ICUAS 2024
Aerial vehicle; Experience replay; Human-centric; Multi objective; Reinforcement learnings; Rescue missions; Search and rescue; Search missions; Trajectory Planning; Vehicle trajectories; Aerospace Engineering; Control and Optimization; Modeling and Simulation
Résumé :
[en] The integration of Unmanned Aerial Vehicles (UAVs) into Search and Rescue (SAR) missions presents a promising avenue for enhancing operational efficiency and effectiveness. However, the success of these missions is not solely dependent on the technical capabilities of the drones but also on their acceptance and interaction with humans on the ground. This paper explores the effect of human-centric factor in UAV trajectory planning for SAR missions. We introduce a novel approach based on the reinforcement learning augmented with Analytic Hierarchy Process and novel similarity-based experience replay to optimize UAV trajectories, balancing operational objectives with human comfort and safety considerations. Additionally, through a comprehensive survey, we investigate the impact of gender cues and anthropomorphism in UAV design on public acceptance and trust, revealing significant implications for drone interaction strategies in SAR. Our contributions include (1) a reinforcement learning framework for UAV trajectory planning that dynamically integrates multi-objective considerations, (2) an analysis of human perceptions towards gendered and anthropomorphized drones in SAR contexts, and (3) the application of similarity-based experience replay for enhanced learning efficiency in complex SAR scenarios. The findings offer valuable insights into designing UAV systems that are not only technically proficient but also aligned with human-centric values.
Disciplines :
Ingénierie aérospatiale
Auteur, co-auteur :
RAMEZANI, Mahya ; University of Luxembourg ; College Of Interdisciplinary Science Of Technology, University Of Tehran, Iran
Atashgah, M.A.; College Of Interdisciplinary Science Of Technology, University Of Tehran, Iran
SANCHEZ LOPEZ, Jose Luis ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Automation
VOOS, Holger ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Automation
Co-auteurs externes :
yes
Langue du document :
Anglais
Titre :
Human-Centric Aware UAV Trajectory Planning in Search and Rescue Missions Employing Multi-Objective Reinforcement Learning with AHP and Similarity-Based Experience Replay
Date de publication/diffusion :
juin 2024
Nom de la manifestation :
2024 International Conference on Unmanned Aircraft Systems (ICUAS)
Lieu de la manifestation :
Chania, Crete, Grc
Date de la manifestation :
04-06-2024 => 07-06-2024
Titre de l'ouvrage principal :
2024 International Conference on Unmanned Aircraft Systems, ICUAS 2024
Maison d'édition :
Institute of Electrical and Electronics Engineers Inc.
M. Ramezani, H. Habibi, J. L. Sanchez-Lopez, and H. Voos, "UAV Path Planning Employing MPC-Reinforcement Learning Method Considering Collision Avoidance, " in 2023 International Conference on Unmanned Aircraft Systems (ICUAS), 2023: IEEE, pp. 507-514.
G. Albeaino, M. Gheisari, and R. R. Issa, "Human-drone interaction (HDI): Opportunities and considerations in construction, " Automation and robotics in the architecture, engineering, and construction industry, pp. 111-142, 2022.
G. Perugia and D. Lisy, "Robot's gendering trouble: A scoping review of gendering humanoid robots and its effects on HRI, " International Journal of Social Robotics, pp. 1-29, 2023.
M. Ramezani and J. L. Sanchez-Lopez, "To The Effects of Anthropomorphic Cues on Human Perception of Non-Human Robots: The Role of Gender, " arXiv preprint arXiv: 2309. 12001, 2023.
J. Fink, "Anthropomorphism and human likeness in the design of robots and human-robot interaction, " in Social Robotics: 4th International Conference, ICSR 2012, Chengdu, China, October 29-31, 2012. Proceedings 4, 2012: Springer, pp. 199-208.
B. R. Duffy, "The social robot paradox, " in Position Paper for the Workshop Sociality with Machines. Shaping Relationsships with Machines, Vienna, 2004: Citeseer.
C. Bartneck and J. Forlizzi, "A design-centred framework for social human-robot interaction, " in RO-MAN 2004. 13th IEEE international workshop on robot and human interactive communication (IEEE Catalog No. 04TH8759), 2004: IEEE, pp. 591-594.
B. A. Duncan and R. R. Murphy, "Effects of speed, cyclicity, and dimensionality on distancing, time, and preference in human-aerial vehicle interactions, " ACM Transactions on Interactive Intelligent Systems (TiiS), vol. 7, no. 3, pp. 1-27, 2017.
W. Jensen, S. Hansen, and H. Knoche, "Knowing you, seeing me: Investigating user preferences in drone-human acknowledgement, " in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018, pp. 1-12.
K. S. Haring et al., "Robot authority in human-robot teaming: Effects of human-likeness and physical embodiment on compliance, " Frontiers in Psychology, vol. 12, p. 625713, 2021.
H. Chitikena, F. Sanfilippo, and S. Ma, "Robotics in Search and Rescue (SAR) Operations: An Ethical and Design Perspective Framework for Response Phase, " Applied Sciences, vol. 13, no. 3, p. 1800, 2023.
R. D. Arnold, H. Yamaguchi, and T. Tanaka, "Search and rescue with autonomous flying robots through behavior-based cooperative intelligence, " Journal of International Humanitarian Action, vol. 3, no. 1, pp. 1-18, 2018.
J. Robertson, "Gendering humanoid robots: Robo-sexism in Japan, " Body & Society, vol. 16, no. 2, pp. 1-36, 2010.
K. Seaborn and P. Pennefather, "Neither "hear" nor "their": Interrogating gender neutrality in robots, " in 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2022: IEEE, pp. 1030-1034.
J. Bernotat, F. Eyssel, and J. Sachse, "The (fe) male robot: How robot body shape impacts first impressions and trust towards robots, " International Journal of Social Robotics, vol. 13, pp. 477-489, 2021.
R. Rassin, S. Ravfogel, and Y. Goldberg, "DALLE-2 is seeing double: Flaws in word-to-concept mapping in Text2Image models, " arXiv preprint arXiv: 2210. 10606, 2022.
F. Eyssel and F. Hegel, "(s) he's got the look: Gender stereotyping of robots 1, " Journal of Applied Social Psychology, vol. 42, no. 9, pp. 2213-2230, 2012.
M. Zhang, J. Cui, and J. Zhong, "How consumers react differently toward humanoid vs. nonhumanoid robots after service failures: A moderated chain mediation model, " International Journal of Emerging Markets, 2023.
S. J. Stroessner and J. Benitez, "The social perception of humanoid and non-humanoid robots: Effects of gendered and machinelike features, " International Journal of Social Robotics, vol. 11, pp. 305-315, 2019.
M. A. Goodrich and A. C. Schultz, "Human-robot interaction: A survey, " Foundations and Trends® in Human-Computer Interaction, vol. 1, no. 3, pp. 203-275, 2008.
L. Zhang, J. Peng, W. Yi, H. Lin, L. Lei, and X. Song, "A State-Decomposition DDPG Algorithm for UAV Autonomous Navigation in 3D Complex Environments, " IEEE Internet of Things Journal, 2023.
S. Dankwa and W. Zheng, "Twin-delayed ddpg: A deep reinforcement learning technique to model a continuous movement of an intelligent robot agent, " in Proceedings of the 3rd international conference on vision, image and signal processing, 2019, pp. 1-5.
T. L. Saaty, "The analytic hierarchy process: Planning, priority setting, resource allocation, " ed: McGraw-Hill, New York London, 1980.