Building Modeling; City Modeling; Classification; Digital Twins; Feature Extraction; Robust Regression; Semantic Segmentation
Abstract :
[en] The building footprint is crucial for a volumetric 3D representation of a building that is applied in urban planning, 3D city modeling, cadastral and topographic map generation. Aerial laser scanning (ALS) has been recognized as the most suitable means of large-scale 3D point cloud data (PCD) acquisition. PCD can produce geometric detail of a scanned surface. However, it is almost impossible to get point clouds without noise and outliers. Besides, data incompleteness and occlusions are two common phenomena for PCD. Most of the existing methods for building footprint extraction employ classification, segmentation, voting techniques (e.g., Hough-Transform or RANSAC), or Principal Component Analysis (PCA) based methods. It is known that classical PCA is highly sensitive to outliers, even RANSAC which is known as a robust technique for shape detection is not free from outlier effects. This paper presents a novel algorithm that employs MCMD (maximum consistency within minimum distance), MSAC (a robust variant of RANSAC) and a robust regression to extract reliable building footprints in the presence of outliers, missing points and irregular data distributions. The algorithm is successfully demonstrated through two sets of ALS PCD.
Research center :
Department of Geodesy and Geospatial Engineering, FSTM, UL
Disciplines :
Engineering, computing & technology: Multidisciplinary, general & others
Author, co-author :
Nurunnabi, Abdul Awal Md ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
Teferle, Felix Norman ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
Balado, Jesus; CINTECX, GeoTECH Group > University of Vigo, Spain
Chen, Meida; 3Institute for Creative Technologies, > University of Southern California, Los Angeles, USA
Poux, Florent; Geomatics Unit, Faculty of Science > University of Liège, Belgium
Sun, Chayn; School of Mathematical and Geospatial Sciences > RMIT University, Melbourne, Australia
External co-authors :
yes
Language :
English
Title :
Robust Techniques for Building Footprint Extraction in Aerial Laser Scanning 3D Point Clouds
Publication date :
November 2022
Event name :
Gi4DM 2022 & Urban Geoinformatics 2022
Event place :
Beijing, China
Event date :
from 01-11-2022 to 04-11-2022
Audience :
International
Main work title :
Robust Techniques for Building Footprint Extraction in Aerial Laser Scanning 3D Point Clouds
AHN3: Actueel Hoogtebestand Nederland data: https://app.pdok.nl/ahn3-downloadpage/
Awrangjeb, M., Lu, G., 2014. Automatic building footprint extraction and regularisation from LIDAR point cloud data. Int. Conf. Digital Image Computing: Tech. and Appl. (DICTA), 25–27 Nov. 2014, Wollongong, Australia.
Balado, J., Diaz-Vilarino, L., Arias, P., Gonzalez-Jorge, H., 2018. Automatic classification of urban ground elements from mobile laser scanning data. Autom. Constr., 86: 226–239.
Buyukdemircioglu, M., Can, R., Kocaman, S., Kada, M., 2022. Deep learning-based building footprint extraction from very high resolution true orthophotos and NDSM. ISPRS annals of the Photogramm. Remote Sens. and Spat Info. Sci., Vol. V-2., 211–218.
Campbell, J. B., Wynne, R. H., 2011. Introduction to Remote Sensing. Guilford publications, NY.
Chen, M., Feng, A., McAlinden, R., Soibelman, L., 2020. Photogrammetric point cloud segmentation and object information extraction for creating virtual environments and simulations. J. Manage. Eng., 36(2): 04019046.
Choi, S., Kim, T., Yu, W., 2009. Performance evaluation of RANSAC family. BMVC, London, UK, September 7–10, 2009.
Dalitz, C., Schramke, T., Jeltsch, M., 2017. Iterative Hough Transform for line detection in 3D point clouds. Image Process. Line, 7: 184–196.
Dimitrov, H., Petrova-Antonova, D., 2021. 3d city model as a first step towards digital twin of Sofia city. Int. Arch. of the Photogramm. Remote Sens. and Spat Info. Sci., Vol. XLIII-B4, 23–30.
Ebrahimi, S. M., Arefi, H., Veis, H R. 2017. Aerial imagery and lidar data fusion for unambiguous extraction of adjacent level-buildings’ footprints. Int. Arch. of the Photogramm. Remote Sens. and Spat Info. Sci., Vol. XLII-4/W4. 179–183.
Fischler, M. A., Bolles, R., 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM. 24(6): 381–395.
He, K., Gkioxari, G., Dollár, P., Girshick, R., 2017. Mask R-CNN. IEEE ICCV, 2961-2969.
Hu, Q., et al., 2020. RandLA-Net: Efficient semantic segmentation of large-scale point clouds. CVPR, 11108–11117.
Mohamed, S. A., Mahmoud, A. S., Moustafa, M. S., Helmy, A. k., Nasr, A. H., 2022. Building footprint extraction in dense area from LiDAR data using Mask R-CNN. Int. J. Advanced Computer Sci. App., 13(6), 346–353.
Neidhert, H., Sester, M., 2008. Extraction of building ground plans from lidar data. Int. Arch. of the Photogramm. Remote Sens. and Spat Info. Sci, Vol. XXXVII-B2. 405–410.
Nex et al., 2013. Building footprint extraction from oblique imagery. ISPRS annals of the Photogramm. Remote Sens. and Spat Info. Sci., vol. II-3/W3, 61–66.
Nurunnabi, A., Belton, D., West, G., 2012. Diagnostic-robust statistical analysis for local surface fitting in 3D point cloud data. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., 1–3, 269–274.
Nurunnabi, A., Belton, D., West, G., 2014. Robust statistical approaches for local planar surface fitting in 3D laser scanning data. ISPRS J. Photogramm. Remote Sens., 96: 106–122.
Nurunnabi, A., West, G., Belton, D., 2015. Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data. Pattern Recognit. 48(4): 1404–1419.
Nurunnabi, A., West, G., Belton, D., 2016a. Robust locally weighted regression techniques for ground surface points filtering in mobile laser scanning 3D point cloud data. IEEE Trans. Geosci. Remote Sens. 54(4): 2181–2193.
Nurunnabi, A., Belton, D., West, G., 2016b. Robust segmentation for large volumes of laser scanning three-dimensional point cloud data, IEEE Trans. Geosci. Remote Sens. 54(8), 4790–4805.
Nurunnabi, A., Teferle, N., Li, J., Lindenbergh, R., Hunegnaw, A., 2021. An efficient deep learning approach for ground point filtering in aerial laser scanning point clouds. Int. Arch. of the Photogramm. Remote Sens. and Spat Info. Sci., Vol. XLIII-B1. 31–38.
Park, Y., Guldmann, J-M., 2019. Creating 3D city models with building footprints and LIDAR point cloud classification: A machine learning approach. Comput. Environ. Urban Syst., 75: 76–89.
Qi, C.R., Su, H., Mo, K., Guibas, L.J., 2017. Pointnet: Deep learning on point sets for 3d classification and segmentation. IEEE CVPR, 652–660.
Rau, J-Y., Lin, B-C., 2011. Automatic roof model reconstruction from ALS data and 2D ground plans based on side projection and the TMR algorithm. ISPRS J. Photogramm. Remote Sens., 66: S13–S27.
Rousseeuw, P. J., Leroy, A. M., 2003. Robust Regression and Outlier Detection. Wiley & Sons, NY.
Schuegraf, B., Bittner, K., 2019. Automatic building footprint extraction from multi-resolution remote sensing images using a hybrid FCN. ISPRS Int. J. Geo-Info., 8, 191, 1–16.
Sun, X., Zhao, W., Maretto, R. V., Persello, C., 2021. Building outline extraction from aerial imagery and digital surface model with a frame field learning framework. Int. Arch. of the Photogramm. Remote Sens. and Spat Info. Sci, Vol. XLIII-B2, 487–493.
Thomas, H., Qi, C. R., Deschaud, J. E., Marcotegui, B., Goulette, F., Guibas, L. J., 2019. KPConv: Flexible and deformable convolution for point clouds. IEEE Int. Conf. Computer Vision, 6411–6420.
Torr, P. H. S., Zisserman, A., 2000. MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding, 78:138–156.
Widyaningrum, E., Gorte, B., Lindenbergh, R., 2019, Automatic building outline extraction from ALS point clouds by ordered points aided Hough Transform. Remote Sens., 11, 1727, 1–29.
Yang, B., Wei, Z., Li, Q., Li, J., 2013. Semiautomated building facade footprint extraction from mobile LiDAR point clouds. IEEE Geosci. Remote Sens. Lett., 10 (4): 766–770.
Zeng, C., Wang, J., 2013. An evaluation system for building footprint extraction from remotely sensed data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 6(3): 1640–1652.
Zhao, W., Persello, C., Stein, A., 2021. Building outline delineation: From aerial images to polygons with an improved end-to-end learning framework. ISPRS J. Photogramm. Remote Sens., 175: 119–131.
