Airborne Multi-Sensor; City Modelling; Geospatial Data; Laser Scanning; Photogrammetry; Registration; Airborne multi-sensor; City model; Data gap; Geo-spatial data; Laser scanning; Multi sensor; Multiple source; Point-clouds; Source points; Instrumentation; Environmental Science (miscellaneous); Earth and Planetary Sciences (miscellaneous)
Abstract :
[en] Point cloud fusion is a process plays pivotal role in geospatial data analysis that aims to integrate data from multiple sources to create a comprehensive and precise representation of the environment. Integrating point clouds acquired from cross-source or hybrid sensors presents unique challenges due to differences in geometric accuracy, precision, and the size of data gaps, along with variations in available attributes. Significant progress has been made in developing algorithms and methods to address these challenges, but the problems are not sufficiently resolved and remain one of the most challenging aspects of geospatial data processing. In this paper, we present a new approach for airborne cross-source point cloud fusion through a slice-to-slice adjustment. Our method generates cross-sectional slices and aligns them following some sequential steps. This approach enhances the accuracy and completeness of the fused point cloud, overcoming issues related to geometric disparities and data gaps. Experimental results demonstrate the effectiveness of our approach in improving registration accuracy, preserving geometric detail, and providing valuable insights for utilizing the potentials of both data sources.
Disciplines :
Civil engineering
Author, co-author :
PARVAZ, Shahoriar ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
TEFERLE, Félicia Norma Rebecca ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
NURUNNABI, Abdul Awal Md ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Engineering (DoE)
External co-authors :
no
Language :
English
Title :
Airborne Cross-Source Point Clouds Fusion by Slice-to-Slice Adjustment
Publication date :
31 May 2024
Event name :
8th International Conference on Smart Data and Smart Cities (SDSC)
Event place :
Athens, Grc
Event date :
04-06-2024 => 07-06-2024
Audience :
International
Journal title :
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
This study is funded through Project No 17042266, DF4CM - Reporting/22/IS, Luxembourg National Research Fund (FNR). We also thank the Administration du Cadastre et de la topographie (ACT) for the Airborne oblique imagery and LiDAR dataset. Abdul Nurunnabi is funded through the IASAUDACITY- PIONEER-2022 project at the University of Luxembourg.
Abdelazeem, M., Elamin, A., Afifi, A., El-Rabbany, A., 2021. Multi-sensor point cloud data fusion for precise 3D mapping. The Egyptian Journal of Remote Sensing and Space Science, 24(3, Part 2), 835 - 844.
Ali, S. A., Golyanik, V., Stricker, D., 2018. Nrga: Gravitational approach for non-rigid point set registration. International Conference on 3D Vision (3DV), 756 - 765.
Aoki, Y., Goforth, H., Srivatsan, R. A., Lucey, S., 2019. Pointnetlk: Robust efficient point cloud registration using pointnet. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 7156 - 7165.
Besl, P., McKay, N. D., 1992. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 239 - 256.
Cavegn, S., Haala, N., Nebiker, S., Rothermel, M., Tutzauer, P., 2014. Benchmarking high density image matching for oblique airborne imagery. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-3, 45 - 52.
Chang, S., Ahn, C., Lee, M., Oh, S., 2020. Graph-matchingbased correspondence search for nonrigid point cloud registration. Computer Vision and Image Understanding, 192, 102899.
Charles, R. Q., Su, H., Kaichun, M., Guibas, L. J., 2017. Pointnet: Deep learning on point sets for 3d classification and segmentation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 77 - 85.
Cleveland,W. S., 1979. Robust locally weighted regression and smoothing scatterplots. Journal of the American Statistical Association, 74(368), 829 - 836.
Fu, K., Luo, J., Luo, X., Liu, S., Zhang, C., Wang, M., 2023. Robust point cloud registration framework based on deep graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(5), 6183 - 6195.
Glira, P., Pfeifer, N., Mandlburger, G., 2019. Hybrid orientation of airborne LiDAR point cloud and aerial images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2/W5, 567 - 574.
Haala, N., Kölle, M., Cramer, M., Laupheimer, D., Mandlburger, G., Glira, P., 2020. Hybrid georeferencing, enhancement and classification of ultra-high resolution UAV LiDAR and image point cloud for monitoring applications. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2-2020, 727 - 734.
Huang, X., Mei, G., Zhang, J., 2020. Feature-metric registration: A fast semi-supervised approach for robust point cloud registration without correspondences. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 11363 - 11371.
Huang, X., Mei, G., Zhang, J., 2023. Cross-source point cloud registration: Challenges, progress and prospects. Neurocomputing, 548, 126383.
Huang, X., Mei, G., Zhang, J., Abbas, R., 2021. A comprehensive survey on point cloud registration.
Huang, X., Zhang, J., Fan, L., Wu, Q., Yuan, C., 2017. A systematic approach for cross-Source point cloud registration by preserving macro and micro structures. IEEE Transactions on Image Processing, 26(7), 3261 - 3276.
Laefer, D., Abuwarda, S., Vo, A.-V., Truong-Hong, L., Gharibi, H., 2017. 2015 aerial laser and photogrammetry survey of dublin city collection record. Leslar, M., 2015. Integrating terrestrial LiDAR with point created from unmanned aerial vehicle imagery. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-1/W4, 97 - 101.
Li, L., Wang, R., Zhang, X., 2021. A tutorial review on point cloud registrations: principle, classification, comparison, and technology challenges. Mathematical Problems in Engineering.
Li, P., Wang, R., Wang, Y., Tao, W., 2020. Evaluation of the ICP algorithm in 3D point cloud registration. IEEE Access, 8, 68030 - 68048.
Mandlburger, G., Wenzel, K., Spitzer, A., Haala, N., Glira, P., Pfeifer, N., 2017. Improved topographic models via concurrent airborne LiDAR and dense image matching. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2/W4, 259 - 266.
Moe, K., Toschi, I., Poli, D., Lago, F., Schreiner, C., Legat, K., Remondino, F., 2016. Changing the production pipeline - use of oblique aerial cameras for mapping purposes. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLI-B4, 631 - 637.
Nurunnabi, A., Teferle, F. N., Li, J., Lindenbergh, R. C., Parvaz, S., 2021. Investigation of PointNet for semantic segmentation of large-scale outdoor point clouds. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVI-4/W5-2021, 397 - 404.
Nurunnabi, A., West, G., Belton, D., 2015. Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data. Pattern Recognition, 48(4), 1404 - 1419.
Nurunnabi, A., West, G., Belton, D., 2016. Robust locally weighted regression techniques for ground surface points filtering in mobile laser scanning three dimensional point cloud data. IEEE Transactions on Geoscience and Remote Sensing, 54(4), 2181 - 2193.
Peng, S., Ma, H., Zhang, L., 2019. Automatic registration of optical images with airborne LiDAR point cloud in urban scenes based on line-point similarity invariant and extended collinearity equations. Sensors, 19(5).
Remondino, F., Spera, M. G., Nocerino, E., Menna, F., Nex, F., 2014. State of the art in high density image matching. The Photogrammetric Record, 29(146), 144 - 166.
Rusu, R. B., Blodow, N., Marton, Z. C., Beetz, M., 2008. Aligning point cloud views using persistent feature histograms. IEEE international conference on intelligent robots and systems, IEEE, 3384 - 3391.
Tajdari, F., Huysmans, T., Song, Y., 2023. Non-rigid registration via intelligent adaptive feedback control. IEEE Transactions on Visualization and Computer Graphics, 1 - 17.
Toschi, I., 2019. Airborne oblique imaging: towards the hybrid era. Archives of Photogrammetry, Cartography and Remote Sensing, 31(1), 21 - 28.
Toschi, I., Farella, E., Welponer, M., Remondino, F., 2021. Quality-based registration refinement of airborne LiDAR and photogrammetric point clouds. ISPRS Journal of Photogrammetry and Remote Sensing, 172, 160 - 170.
Toschi, I., Remondino, F., Rothe, R., Klimek, K., 2018. Combining airborne oblique camera and LiDAR sensors: investigation and new perspectives. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-1, 437 - 444.
Wang, Y., Bu, S., Chen, L., Dong, Y., Li, K., Cao, X., Li, K., 2023. Hybridfusion: Lidar and vision cross-source point cloud fusion.
Yang, W., Liu, Y., He, H., Lin, H., Qiu, G., Guo, L., 2021. Airborne LiDAR and photogrammetric point cloud fusion for extraction of urban tree metrics according to street network segmentation. IEEE Access, 9, 97834 - 97842.
Yu, H., Li, F., Saleh, M., Busam, B., Ilic, S., 2021. CoFiNet: Reliable Coarse-to-fine Correspondences for Robust PointCloud Registration. Advances in Neural Information Processing Systems, 34.
Zhang, Z., Dai, Y., Sun, J., 2020. Deep learning based point cloud registration: an overview. Virtual Reality and Intelligent Hardware, 2(3), 222 - 246.
Zhang, Z., Gerke, M., Vosselman, G., Yang, M. Y., 2018. A patch-based method for the evaluation of dense image matching quality. International Journal of Applied Earth Observation and Geoinformation, 70, 25 - 34.
Zhang, Z., Vosselman, G., Gerke, M., Persello, C., Tuia, D., Yang, M. Y., 2019. Detecting building changes between airborne laser scanning and photogrammetric data. Remote Sensing, 11(20).
