基于改进的PointNet++模型的多光谱LiDAR数据分类方法
Multispectral LiDAR Data Classification Method Based on an Improved PointNet++ Model
摘要: 多光谱激光雷达(LiDAR)系统可同时并快速获取大范围空间目标地物的光谱强度信息和空间几何信息,为三维点云分类、语义分割、目标检测等研究提供新的数据源。然而,由于多光谱点云数据分布的不规则性以及数据量巨大等特性,使得地物特征的提取过程充满挑战。本文通过将通道注意力机制(SE-Block)和修正后的焦点损失函数嵌入至PointNet++网络中,提出了一种改进的PointNet++网络架构。PointNet++网络从不均匀采样的点中提取局部特征,并通过多尺度分组表示点之间的局部几何关系。将SE-Block嵌入至PointNet++网络中,通过显式地建模通道之间的相互依赖关系,自适应地重新校准通道方面的特征响应,从而强调重要通道并抑制不利于预测的无用通道,提高特征的显著性,以便更好地进行点云分类。另外,本文在改进的网络架构基础上利用修正后的焦点损失函数解决了多光谱LiDAR点云数据中类别不均匀分布的问题。本文提出的改进的PointNet++网络架构在托伯莫里港口数据集上进行了评估,获得的总体精度、mIoU、F1-score和Kappa系数分别为95.21%、62.59%、73.58%、0.918。与5个已建立的深度神经网络模型的比较实验证实,本文提出的改进的PointNet++网络架构在多光谱LiDAR点云分类任务中具有良好的性能。
Abstract: A multispectral light detection and ranging (LiDAR) system can simultaneously and quickly collect spectral intensity information and spatial geometric data of a large range of space objects, which provides a new data source for the research of 3D point cloud classification, semantic segmentation and object detection. However, due to the irregularly distributed property of multispectral point cloud data and massive data volume, the extraction process of land cover is full of challenges. In this paper, we propose an improved PointNet++ network architecture by embedding the Squeeze and Excitation Bock (SE-Block) and a modified focal loss function into the PointNet++ network. Point-Net++ network extracts local features from unevenly sampled points and represents local geomet-rical relationships among the points through multi-scale grouping. SE-Block is embedded into PointNet++ network, which explicitly models the interdependence between channels and adap-tively recalibrates the feature response in terms of channels, emphasizing important channels and suppressing useless channels that are not conducive to prediction, improving the saliency of fea-tures for better point cloud classification. In addition, based on the improved network architecture, this article utilizes the modified focal loss function to solve the problem of uneven distribution of categories in multispectral LiDAR point cloud data. The improved PointNet++ network architecture proposed in this paper has been evaluated on the Tobermory Port dataset and achieved an overall accuracy, a mean Intersection over Union (mIoU), an F1-score, and a Kappa coefficient of 95.21%, 62.59%, 73.58% and 0.918, respectively. Comparative studies with five established deep neural network models confirm that the improved PointNet++ network architecture proposed in this pa-per has good performance in multispectral LiDAR point cloud classification tasks.
文章引用:景庄伟, 丁荣莉, 何恒翔, 李丰, 谷岳. 基于改进的PointNet++模型的多光谱LiDAR数据分类方法[J]. 测绘科学技术, 2024, 12(1): 64-76. https://doi.org/10.12677/GST.2024.121009

参考文献

[1] Wen, C., Yang, L., Li, X., Peng, L. and Chi, T. (2020) Directionally Constrained Fully Convolutional Neural Network for Air-borne LiDAR Point Cloud Classification. ISPRS Journal of Photogrammetry and Remote Sensing, 162, 50-62. [Google Scholar] [CrossRef
[2] Li, W., Wang, F. and Xia, G. (2002) A Geometry-Attentional Net-work for ALS Point Cloud Classification. ISPRS Journal of Photogrammetry and Remote Sensing, 164, 26-40. [Google Scholar] [CrossRef
[3] Yan, W.Y., Shaker, A. and El-Ashmawy, N. (2015) Urban Land Cover Classification Using Airborne LiDAR Data: A Review. Remote Sensing of Environment, 158, 295-310. [Google Scholar] [CrossRef
[4] 杨必胜, 梁福逊, 黄荣刚. 三维激光扫描点云数据处理研究进展、挑战与趋势[J]. 测绘学报, 2017, 46(10): 1509-1516.
[5] Blackman, R. and Yuan, F. (200) Detecting Long-Term Urban Forest Cover Change and Impacts of Natural Disasters Using High-Resolution Aerial Images and LiDAR Data. Remote Sensing, 12, Article 1820. [Google Scholar] [CrossRef
[6] 吴杭彬. 融合航空影像的机载激光扫描数据分类与特征提取[J]. 测绘学报, 2011, 40(1): 134.
[7] 王宏涛, 雷相达, 赵宗泽. 融合光谱信息的机载LiDAR点云三维深度学习分类方法[J]. 激光与光电子学进展, 2020, 57(12): 340-347.
[8] 释小松, 程英蕾, 薛豆豆, 秦先祥. 基于Point-Net的多源融合点云地物分类方法[J]. 激光与光电子学进展, 2020, 57(8): 170-178.
[9] Zhou, K., Ming, D., Lv, X., Fang, J. and Wang, M. (2019) CNN-Based Land Cover Classification Combining Stratified Segmentation and Fusion of Point Cloud and Very High-Spatial Resolution Remote Sensing Image Data. Remote Sensing, 11, Article 2065. [Google Scholar] [CrossRef
[10] 康健, 管海燕, 于永涛, 等. 基于RFA-LinkNet模型的高分遥感影像水体提取[J]. 南京信息工程大学学报, 2023, 15(2): 160-168.
[11] Teo, T.A. and Wu, H.M. (2017) Analysis of Land Cover Classification Using Multi-Wavelength LiDAR Sys-tem. Applied Sciences, 7, Article 663. [Google Scholar] [CrossRef
[12] Fernandez-Diaz, J.C., Carter, W.E., Glen-nie, C., Shrestha, R.L., Pan, Z., Ekhtari, N., Singhania, A., Hauser, D. and Sartori, M. (2016) Capability Assessment and Per-formance Metrics for the Titan Multispectral Mapping Lidar. Remote Sensing, 8, Article 936. [Google Scholar] [CrossRef
[13] Morsy, S., Shaker, A., El-Rabbany, A. and LaRocque, P.E. (2016) Airborne Mul-tispectral LiDAR Data for Land-Cover Classification and Land/Water Mapping Using Different Spectral Indexes. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 3, 217-224. [Google Scholar] [CrossRef
[14] Yu, Y., Guan, H., Li, D., Gu, T., Wang, L., Ma, L. and Li, J. (2019) A Hybrid Capsule Network for Land Cover Classification Using Multispectral LiDAR Data. IEEE Geoscience and Re-mote Sensing Letters, 17, 1263-1267. [Google Scholar] [CrossRef
[15] Huo, L.Z., Silva, C.A., Klauberg, C., Mohan, M., Zhao, L.J., Tang, P. and Hudak, A.T. (2018) Supervised Spatial Classification of Multispectral LiDAR Data in Urban Areas. PLOS ONE, 13, e0206185. [Google Scholar] [CrossRef] [PubMed]
[16] 潘锁艳, 管海燕. 机载多光谱LiDAR数据的地物分类方法[J]. 测绘学报, 2018, 47(2): 198-207.
[17] Pan, S., Guan, H., Yu, Y., Li, J. and Peng, D. (2019) A Comparative Land-Cover Classi-fication Feature Study of Learning Algorithms: DBM, PCA, and RF Using Multispectral LiDAR Data. IEEE Journal of Select-ed Topics in Applied Earth Observations and Remote Sensing, 12, 1314-1326. [Google Scholar] [CrossRef
[18] Wang, Q. and Gu, Y. (2019) A Discriminative Tensor Representa-tion Model for Feature Extraction and Classification of Multispectral LiDAR Data. IEEE Transactions on Geoscience and Re-mote Sensing, 58, 1568-1586. [Google Scholar] [CrossRef
[19] Morsy, S., Shaker, A. and El-Rabbany, A. (2017) Multispectral Li-DAR Data for Land Cover Classification of Urban Areas. Sensors, 17, Article 958. [Google Scholar] [CrossRef] [PubMed]
[20] Ekhtari, N., Glennie, C. and Fernandez-Diaz, J.C. (2018) Classification of Air-borne Multispectral LiDAR Point Clouds for Land Cover Mapping. IEEE Journal of Selected Topics in Applied Earth Observa-tions and Remote Sensing, 11, 2068-2078. [Google Scholar] [CrossRef
[21] Wichmann, V., Bremer, M., Lindenberger, J., Rutzinger, M., Georges, C. and Petrini-Monteferri, F. (2015) Evaluating the Potential of Multispectral Airborne LIDAR for Topographic Mapping and Land Cover Classification. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, II-3/W5, 113-119. [Google Scholar] [CrossRef
[22] 赵沛冉, 管海燕, 李迪龙, 等. 利用样本生成方法进行机载多光谱LiDAR数据深度学习分类[J]. 测绘通报, 2021(12): 16-21.
[23] 袁鹏飞, 黄荣刚, 胡平波, 杨必胜. 基于多光谱LiDAR数据的道路中心线提取[J]. 地球信息科学学报, 2018, 20(4): 452-461.
[24] 景庄伟, 管海燕, 臧玉府, 等. 基于深度学习的点云语义分割研究综述[J]. 计算机科学与探索, 2021, 15(1): 1-26.
[25] Li, D.L., et al. (2020) Building Ex-traction from Airborne Multi-Spectral LiDAR Point Clouds Based on Graph Geometric Moments Convolutional Neural Net-works. Remote Sensing, 12, Article 3186.
[26] Briechle, S., Krzystek, P. and Vosselman, G. (2020) Classification of Tree Spe-cies and Standing Dead Trees by Fusing UAV-Based Lidar Data and Multispectral Imagery in the 3D Deep Neural Network PointNet++. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2-2020, 203-210.
[27] Shi, S., et al. (2021) Land Cover Classification with Multispectral LiDAR Based on Multi-Scale Spatial and Spectral Feature Selection. Remote Sensing, 13, Article 4118.
[28] Qi, C.R., Su, H., Mo, K. and Guibas, L.J. (2017) PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, 21-26 July 2017, 77-85.
[29] Qi, C.R., Yi, L., Su, H. and Guibas, L.J. (2017) PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the Neural Infor-mation Processing Systems (NIPS 2017), Long Beach, 4-7 December 2017, 5105-5114.
[30] Wang, Y., Sun, Y., Liu, Z., Sar-ma, S.E., Bronstein, M.M. and Solomon, J.M. (2018) Dynamic Graph CNN for Learning on Point Clouds. ACM Transactions on Graphics, 38, 1-12. [Google Scholar] [CrossRef
[31] Wang, L., Huang, Y., Hou, Y., Zhang, S. and Shan, J. (2019) Graph Attention Convolution for Point Cloud Semantic Segmentation. Proceedings of the 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019), Long Beach, 15-20 June 2019, 10288-10297. [Google Scholar] [CrossRef
[32] Liu, Y., Fan, B., Xiang, S. and Pan, C. (2019) Relation-Shape Convolu-tional Neural Network for Point Cloud Analysis. Proceedings of the 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019), Long Beach, 15-20 June 2019, 8887-8896. [Google Scholar] [CrossRef
[33] Hu, J., Shen, L. and Sun, G. (2018) Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018), Salt Lake City, 19-21 June 2018, 7132-7141. [Google Scholar] [CrossRef
[34] Hu, Q., Yang, B., Xie, L., et al. (2020) RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog-nition, Seattle, 13-19 June 2020, 11105-11114. [Google Scholar] [CrossRef
[35] Lin, T.Y., Goyal, P., Girshick, R., He, K. and Dollar, P. (2020) Focal Loss for Dense Object Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 318-327. [Google Scholar] [CrossRef