Paper published in a book (Scientific congresses, symposiums and conference proceedings)
An efficient deep learning approach for ground point filtering in aerial laser scanning point clouds
Nurunnabi, Abdul Awal Md; TEFERLE, Felix Norman; Li, Jonathanet al.
2021 • In Nurunnabi, Abdul Awal Md; Teferle, Felix Norman; Li, Jonathanet al. (Eds.) An efficient deep learning approach for ground point filtering in aerial laser scanning point clouds
[en] Ground surface extraction is one of the classic tasks in airborne laser scanning (ALS) point cloud processing that is used for three-dimensional (3D) city modelling, infrastructure health monitoring, and disaster management. Many methods have been developed over the last three decades. Recently, Deep Learning (DL) has become the most dominant technique for 3D point cloud classification. DL methods used for classification can be categorized into end-to-end and non end-to-end approaches. One of the main challenges of using supervised DL approaches is getting a sufficient amount of training data. The main advantage of using a supervised non end-to-end approach is that it requires less training data. This paper introduces a novel local feature-based non end-to-end DL algorithm that generates a binary classifier for ground point filtering. It studies feature relevance, and investigates three models that are different combinations of features. This method is free from the limitations of point clouds’ irregular data structure and varying data density, which is the biggest challenge for using the elegant convolutional neural network. The new algorithm does not require transforming data into regular 3D voxel grids or any rasterization. The performance of the new method has been demonstrated through two ALS datasets covering urban environments. The method successfully labels ground and non-ground points in the presence of steep slopes and height discontinuity in the terrain. Experiments in this paper show that the algorithm achieves around 97% in both F1-score and model accuracy for ground point labelling.
Research center :
Department of Geodesy and Geospatial Engineering
Disciplines :
Engineering, computing & technology: Multidisciplinary, general & others
Author, co-author :
Nurunnabi, Abdul Awal Md ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
TEFERLE, Felix Norman ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
Li, Jonathan; University of Waterloo, Canada > Geography and Environmental Management
Lindenbergh, Roderik; Delft University of Technology > Geosciences and Remote Sensing, Faculty of Civil Engineering and Geosciences
HUNEGNAW, Addisu ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
External co-authors :
yes
Language :
English
Title :
An efficient deep learning approach for ground point filtering in aerial laser scanning point clouds
Original title :
[en] An efficient deep learning approach for ground point filtering in aerial laser scanning point clouds
Publication date :
02 July 2021
Event name :
ISPRS Congress, 2021
Event organizer :
International Society of Photogrammetry and Remote Sensing (ISPRS)
Event place :
Nice, France
Event date :
5-9 July, 2021
Audience :
International
Main work title :
An efficient deep learning approach for ground point filtering in aerial laser scanning point clouds
Axelsson, P., 2000. DEM generation from laser scanner data using adaptive TIN models. Int. Arch. of Photogramm. Remote Sens. Spatial Inf. Sci., 33(part B4/1), 110-117.
Bartles, M., Wei, H., Mason, D. C., 2006. DTM generation from LiDAR data using skewness balancing. In Proc. IAPR 18th Int. Conf. Pattern Recognit., 20-24 August, Hong-Kong, China.
Becker, C., Rosinskaya, E., Häni, N., D'Angelo, E., Strecha, C., 2018. Classification of aerial photogrammetric 3d point clouds. Photogramm. Eng Remote Sensing, 84(5), 287-295.
Biasotti, S., Cerri, A., Bronstein, A., Bronstein, M., 2016. A Recent trends, applications, and perspectives in 3D shape similarity assessment. Computer Graphics Forum, 35(6), 87-119.
Chehata, N., Guo, L., Mallet, C., 2009. Airborne lidar feature selection for urban classification using random forests. Laserscanning, Paris, France.
Goodfellow, I., Bengio, Y., Courville, A., 2016. Deep Learning. MIT Press.
Guo, Y., Bennamoun, M. Sohel, F., Lu, M., Wan, J., 2014. 3D object recognition in cluttered scenes with local surface features: a survey. IEEE TPAMI., 36(11), 2270-2284.
Haralick, R., Shapiro, L., 1992. Computer and Robot Vision. Addison-Wesley, Reading, Mass.
Hofle, B., Mucke, W., Dutter, M., Rutzinger, M., Dorninger, M., 2009. Detection of building regions using airborne LiDAR-a new combination of raster and point cloud-based GIS methods. In GI-Forum 2009, Intl. Conf. applied geoinformatics, Salzburg.
Kraus, K., Pfeifer. N., 1998. Determination of terrain models in wooded areas with airborne laser scanner data. ISPRS J. Photogramm. Remote Sens., 53(4), 193-203.
Kumar, A., Anders, K., Winiwarter, L., Hofle, B. 2019. Feature relevance analysis for 3D point cloud classification using deep learning, ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., IV-2/W5.
Lindenberger, J., 1993. Laser-Profilmessungen zur topographischen gelaedeaufnahme, Deutsche Geodaetische Kommission, Series C, No. 400, Munich, Germany.
Ma, L., Li, Y., Li, J., Tan, W., Yu, Y., Chapman, M. A., 2019. Multi-scale point-wise convolutional neural networks for 3d object segmentation from lidar point clouds in large-scale environments. IEEE Trans. Intell. Transp. Syst., 22(2), 821-836.
Nurunnabi, A., West, G., Belton, D., 2016a. Robust locally weighted regression techniques for ground surface points filtering in mobile laser scanning 3D point cloud data. IEEE Trans. Geosci. Remote Sens. 54(4), 2181-2193.
Nurunnabi, A., Belton, D., West, G., 2016b. Robust segmentation for large volumes of laser scanning three-dimensional point cloud data. IEEE Trans. Geosci. Remote Sens., 54(8), 4790-4805.
Nurunnabi, A., Sadahiro, Y., Laefer, D. F., 2018. Robust statistical approaches for circle fitting in laser scanning three-dimensional point cloud data. Pattern Recognit., 81(9), 417-431.
Nurunnabi, A., Sadahiro, Y., Lindenbergh, R., Belton, D., 2019. Robust cylinder fitting in laser scanning point cloud data. Measurement, 138, 632-651.
Özdemir, E., Remondino, F., 2019. Classification of aerial point clouds with deep learning. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., XLII-2/W13.
Pauly, M., Gross M., Kobbelt, L. P., 2002. Efficient simplification of point sample surface. Proc. IEEE Conf. Vis., Washington, D. C., 27 October-1 November, 163-170.
Pfeifer, N., Mandlburger, G., Otepka, J., Karel, W., 2014. OPALS-A framework for Airborne Laser Scanning data analysis. Computers, Env. and Urban Systems 45: 125-136.
Qi, C. R., Su, H., Mo, K., Guibas, L. J., 2017a. PointNet: Deep learning on point sets for 3D classification and segmentation. Proc. IEEE Comput. Soc. CVPR., 652-660.
Qi, C. R., Yi, L., Su, H., Guibas, L. J., 2017b. PointNet++: Deep hierarchical feature learning on point sets in a metric space. arXiv preprint arXiv: 1706. 02413.
Qin, N., Tan, W., Ma, L., Zhang, D., Li, J., 2021. OpenGF: An ultra-large-scale ground filtering dataset built upon open ALS point clouds around the world. https://arxiv. org/pdf/2101. 09641.
Rizaldy, A., Persello, C., Gevaert, C. M. Oude Elberink, S. J., 2018. Fully convolutional networks for ground classification from lidar point clouds. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., 4(2).
Soilán, M., Lindenbergh, R., Riveiro, B., Sánchez Rodríguez, A., 2019. Pointnet for the automatic classification of aerial point clouds. ISPRS Ann. Photogram. Remote Sens. Spatial Inf. Sci., IV-2/W5.
Sithole, G., Vosselman, G., 2004. Experimental comparison of filter algorithms for bare-earth extraction from airborne laser scanning point clouds. ISPRS J. Photogramm. Remote Sens., 59(1-2), 85-101.
Sithole, G., Vosselman, G., 2005. Filtering of airborne laser scanner data based on segmented point clouds. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., 36(part 3), W19.
Vosselman, G., 2000. Slope based filtering of laser altimetry data. Int. Arch. Photogramm. Remote Sens. 33(Part3), 935-942.
Vosselman, G., Coenen, M., Rottensteiner, F., 2017. Contextual segment-based classification of airborne laser scanner data. ISPRS J. Photogramm. Remote Sens., 128, 354-371.
Weinmann, M., Jutzi, B., Hinz, S., Mallet, C., 2015. Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers. ISPRS J. Photogramm. Remote Sens., 105, 286-304.
Widyaningrum, E., Fajari, M. K., Lindenbergh, R. C., Hahn, M., 2020. Tailored features for semantic segmentation with a DG-CNN using free training samples of a colored airborne point cloud. Int. Arch. of the Photogramm. Remote Sens. Spatial Inf. Sci., 43(B2).
Xiu, H., Vinayaraj, P., Kim, K. S., Nakamura, R., Yan, W., 2019. 3D semantic segmentation for high-resolution aerial survey derived point clouds using deep learning. 26th ACM SIGSPATIAL Conf. Adv. in Geographic Inf. Systems, 588-591.
Wang, Y., Sun, Y., Liu, Z., Sarma, S., Bronstein, M., Solomon, J., 2019. Dynamic graph CNN for learning on point clouds, ACM Trans. Graph., 1(1).
Yokoyama, R., Shirasawa, M., Pike, R. J., 2002. Visualizing topography by openness: a new application of image processing to digital elevation models. PE&RS, 68(3), 257-265.
Zakšek, K., Pfeifer, N., 2004. An improved morphological filter for selecting relief points from a LIDAR point cloud in steep areas with dense vegetation. Technical Report, Delft Institute of Earth Observation and Space systems, TU Delft.
Zhang, J., Lin, X., Ning, X., 2013. SVM-based classification of segmented airborne LiDAR point clouds in urban areas. Remote Sens., 5, 3749-3775.
Zhang, L., Li, Z., Li, A., Liu, F., 2018. Large-scale urban point cloud labelling and construction. ISPRS J. Photogramm. Remote Sens., 138, 86-100.