[en] This article presents a real time Unmanned Aerial Vehicles UAVs 3D pose estimation method using planar object tracking, in order to be used on the control system of a UAV. The method explodes the rich information obtained by a projective transformation of planar objects on a calibrated camera. The algorithm obtains the metric and projective components of a reference object (landmark or helipad) with respect to the UAV camera coordinate system, using a robust real time object tracking based on homographies. The algorithm is validated on real flights that compare the estimated data against that obtained by the inertial measurement unit IMU, showing that the proposed method robustly estimates the helicopter's 3D position with respect to a reference landmark, with a high quality on the position and orientation estimation when the aircraft is flying at low altitudes, a situation in which the GPS information is often inaccurate. The obtained results indicate that the proposed algorithm is suitable for complex control tasks, such as autonomous landing, accurate low altitude positioning and dropping of payloads.
L. Mejias, S. Saripalli, P. Campoy, and G. Sukhatme, "Visual servoing approach for tracking features in urban areas using an autonomous helicopter," in Proceedings of IEEE International Conference on Robotics and Automation, Orlando, Florida, May 2006, pp. 2503-2508.
S. Saripalli and G. S. Sukhatme, "Landing a helicopter on a moving target," in Proceedings of IEEE International Conference on Robotics and Automation, Rome, Italy, April 2007, pp. 2030-2035.
T. Merz, S. Duranti, and G. Conte, "Autonomous landing of an unmanned helicopter based on vision and inbertial sensing." in International Symposium on Experimental Robotics, Singapore, June 2004.
P. Campoy, J. F. Correa, I. Mondragón, C. Martínez, M. Olivares, L. Mejías, and J. Artieda, "Computer vision onboard UAVs for civilian tasks," Journal of Intelligent and Robotic Systems., vol. 54, no. 1-3, pp. 105-135, 2009.
Z. He, L. R. V, and C. P. R, "Vision-based UAV flight control and obstacle avoidance," in Proceedings of the American Control Conference, June 2006, p. 5pp.
R. Carnie, R. Walker, and P. Corke, "Image processing algorithms for UAV "sense and avoid"," in Robotics and Automation, 2006. ICRA 2006. Proceedings 2006 IEEE International Conference on, May 2006, pp. 2848-2853.
C. De Wagter and J. Mulder, "Towards vision-based uav situation awareness," AIAA Guidance, Navigation, and Control Conference and Exhibit, August 2005.
S. Saripalli, J. F. Montgomery, and G. S. Sukhatme, "Visually-guided landing of an unmanned aerial vehicle," IEEE Transactions on Robotics and Automation, vol. 19, no. 3, pp. 371-381, June 2003.
S. Hrabar and G. Sukhatme, "Omnidirectional vision for an autonomous helicopter," in In IEEE Internation Conference on Robotics and Automation, 2003, pp. 558-563.
S. Lange, N. Sünderhauf, and P. Protzel, "Autonomous landing for a multirotor UAV using vision," in In Workshop Proceedings of SIMPAR Intl. Conf. on SIMULATION, MODELING and PROGRAMMING for AUTONOMOUS ROBOTS, Venice, Italy, Nov 2008, pp. 482-491.
G. Simon, A. Fitzgibbon, and A. Zisserman, "Markerless tracking using planar structures in the scene," in Augmented Reality, 2000. (ISAR 2000). Proceedings. IEEE and ACM International Symposium on, 2000, pp. 120-128.
G. Simon and M.-O. Berger, "Pose estimation for planar structures," Computer Graphics and Applications, IEEE, vol. 22, no. 6, pp. 46-53, Nov/Dec 2002.
Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on pattern analysis and machine intelligence, vol. 22, no. 11, pp. 1330-1334, 2000.
P. Sturm, "Algorithms for plane-based pose estimation," pp. 1010-1017, June 2000. [Online]. Available: http://perception.inrialpes.fr/ Publications/2000/Stu00b
Bouguet Jean Yves, "Pyramidal implementation of the lucas-kanade feature tracker," Intel Corporation. Microprocessor Research Labs, Santa Clara, CA 95052, Tech. Rep., 1999.
J. Shi and C. Tomasi, "Good features to track," in 1994 IEEE Conference on Computer Vision and Pattern Recognition (CVPR'94), 1994, pp. 593-600.
M. A. Fischer and R. C. Bolles, "Random sample concensus: a paradigm for model fitting with applications to image analysis and automated cartography," Communications of the ACM, vol. 24, no. 6, pp. 381-395, 1981.
A. Criminisi, I. D. Reid, and A. Zisserman, "A plane measuring device," Image Vision Comput., vol. 17, no. 8, pp. 625-634, 1999.
R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge University Press, ISBN: 0521540518, 2004.
S. Hutchinson, G. D. Hager, and P. Corke, "A tutorial on visual servo control," in IEEE Transaction on Robotics and Automation, vol. 12(5), October 1996, pp. 651-670.
F. Chaumette and S. Hutchinson, "Visual servo control. i. basic approaches," Robotics & Automation Magazine, IEEE, vol. 13, no. 4, pp. 82-90, 2006. [Online]. Available: http://dx.doi.org/10.1109/MRA.2006.250573
B. Siciliano and O. Khatib, Eds., Springer Handbook of Robotics. Berlin, Heidelberg: Springer, 2008.
