Semantic situation awareness of ellipse shapes via deep learning for multirotor aerial robots with a 2D LIDAR

in 2020 International Conference on Unmanned Aircraft Systems (ICUAS) (2020, September)

In this work, we present a semantic situation awareness system for multirotor aerial robots equipped with a 2D LIDAR sensor, focusing on the understanding of the environment, provided to have a drift-free ... [more ▼]

In this work, we present a semantic situation awareness system for multirotor aerial robots equipped with a 2D LIDAR sensor, focusing on the understanding of the environment, provided to have a drift-free precise localization of the robot (e.g. given by GNSS/INS or motion capture system). Our algorithm generates in real-time a semantic map of the objects of the environment as a list of ellipses represented by their radii, and their pose and velocity, both in world coordinates. Two different Convolutional Neural Network (CNN) architectures are proposed and trained using an artificially generated dataset and a custom loss function, to detect ellipses in a segmented (i.e. with one single object) LIDAR measurement. In cascade, a specifically designed indirect-EKF estimates the ellipses based semantic map in world coordinates, as well as their velocity. We have quantitative and qualitatively evaluated the performance of our proposed situation awareness system. Two sets of Software-In-The-Loop simulations using CoppeliaSim with one and multiple static and moving cylindrical objects are used to evaluate the accuracy and performance of our algorithm. In addition, we have demonstrated the robustness of our proposed algorithm when handling real environments thanks to real laboratory experiments with non-cylindrical static (i.e. a barrel) objects and moving persons. [less ▲]

A Real-Time Approach for Chance-Constrained Motion Planning with Dynamic Obstacles

in IEEE Robotics and Automation Letters (2020), 5(2), 3620-3625

Uncertain dynamic obstacles, such as pedestrians or vehicles, pose a major challenge for optimal robot navigation with safety guarantees. Previous work on motion planning has followed two main strategies ... [more ▼]

Uncertain dynamic obstacles, such as pedestrians or vehicles, pose a major challenge for optimal robot navigation with safety guarantees. Previous work on motion planning has followed two main strategies to provide a safe bound on an obstacle's space: a polyhedron, such as a cuboid, or a nonlinear differentiable surface, such as an ellipsoid. The former approach relies on disjunctive programming, which has a relatively high computational cost that grows exponentially with the number of obstacles. The latter approach needs to be linearized locally to find a tractable evaluation of the chance constraints, which dramatically reduces the remaining free space and leads to over-conservative trajectories or even unfeasibility. In this work, we present a hybrid approach that eludes the pitfalls of both strategies while maintaining the original safety guarantees. The key idea consists in obtaining a safe differentiable approximation for the disjunctive chance constraints bounding the obstacles. The resulting nonlinear optimization problem is free of chance constraint linearization and disjunctive programming, and therefore, it can be efficiently solved to meet fast real-time requirements with multiple obstacles. We validate our approach through mathematical proof, simulation and real experiments with an aerial robot using nonlinear model predictive control to avoid pedestrians. [less ▲]

Model Predictive Control for Aerial Collision Avoidance in Dynamic Environments

in 26th Mediterranean Conference on Control and Automation (MED), Zadar, Croatia, 19-22 June 2018 (2018, June)

Autonomous navigation in unknown environments populated by humans and other robots is one of the main challenges when working with mobile robots. In this paper, we present a new approach to dynamic ... [more ▼]

Autonomous navigation in unknown environments populated by humans and other robots is one of the main challenges when working with mobile robots. In this paper, we present a new approach to dynamic collision avoidance for multi-rotor unmanned aerial vehicles (UAVs). A new nonlinear model predictive control (NMPC) approach is proposed to safely navigate in a workspace populated by static and/or moving obstacles. The uniqueness of our approach lies in its ability to anticipate the dynamics of multiple obstacles, avoiding them in real-time. Exploiting active set algorithms, only the obstacles that affect to the UAV during the prediction horizon are considered at each sample time. We also improve the fluency of avoidance maneuvers by reformulating the obstacles as orientable ellipsoids, being less prone to local minima and allowing the definition of a preferred avoidance direction. Finally, we present two real-time implementations based on simulation. The former demonstrates that our approach outperforms its analog static formulation in terms of safety and efficiency. The latter shows its capability to avoid multiple dynamic obstacles. [less ▲]