一种基于空间特征的三维点云语义分割模型
A Semantic Segmentation Model of 3D Point Clouds Based on Spatial Features
DOI: 10.12677/CSA.2022.122033, PDF,   
作者: 陈立宜, 赵艮平:广东工业大学计算机学院,广东 广州
关键词: 点云形状特征空间特征关键点Point Cloud Shape Feature Spatial Feature Key Point
摘要: 真实的点云场景通常包含非常复杂的环境,加上三维点云数据所具有的离散性、无序且分布不均匀的属性,针对点云的详细信息分析往往非常具有挑战性。针对以上问题,提出一种基于编码器–解码器的分割网络。首先,通过关键点提取模块获取点云的形状特征并通过全连接层提取形状关键点;然后,通过空间细节提取模块获取基于关键点的空间细节特征;最后,结合形状特征和空间细节特征,获取点云丰富的空间信息及上下文联系,提高网络的泛化能力。实验结果表明,我们的网络在公共数据集Urban Semantic 3D (US3D)和ISPRS Vaihingen 3D semantic labelling benchmark (ISPRS)上的平均交并比分别为93.44%和81.45%。我们的网络分割性能良好,且具有较好的泛化能力。
Abstract: Real point cloud scenes usually contain very complex environments. Coupled with the discrete, dis-ordered and uneven distribution properties of 3D point cloud data, detailed analysis of point clouds is often very challenging. Aiming at the above problems, an encoder-decoder-based segmentation network is proposed. First, the shape features of the point cloud are obtained through the key point extraction module and the shape key points are extracted through the fully connected layer; then, the spatial detail features based on key points are obtained through the spatial detail extraction module; finally, the shape features and spatial detail features are combined to obtain the rich spatial information and contextual connections of point clouds improve the generalization ability of the network. Experimental results show that our network achieves an average intersection ratio of 93.44% and 81.45% on public datasets Urban Semantic 3D (US3D) and ISPRS Vaihingen 3D semantic labelling benchmark (ISPRS), respectively. Our network has good segmentation performance and good generalization ability.
文章引用:陈立宜, 赵艮平. 一种基于空间特征的三维点云语义分割模型[J]. 计算机科学与应用, 2022, 12(2): 331-337. https://doi.org/10.12677/CSA.2022.122033

参考文献

[1] Qi, C.R., Su, H., Niessner, M., Dai, A., Yan, M.Y. and Guibas, L. (2016) Volumetric and Multi-View CNNs for Object Classification on 3D Data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 5648-5656.
[2] Lahoud, J. and Ghanem, B. (2017) 2D-Driven 3D Object Detection in RGB-D Images. 2017 IEEE In-ternational Conference on Computer Vision (ICCV), Venice, 22-29 October 2017, 4632-4640. [Google Scholar] [CrossRef
[3] Qi, C.R., Su, H., Mo, K.C. and Guibas, L.J. (2017) PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 77-85. [Google Scholar] [CrossRef
[4] Qi, C.R., Yi, L., Su, H. and Guibas, L.J. (2017) Pointnet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Ad-vances in Neural Information Processing Systems, 30.
[5] Chen, L., Papandreou, G., Kokkinos, I., Murphy, K. and Yuille, A.L. (2017) DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848. [Google Scholar] [CrossRef
[6] Long, J., Shelhamer, E. and Darrell, T. (2015) Fully Convolu-tional Networks for Semantic Segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition, Bos-ton, 7-12 June 2015, 3431-3440. [Google Scholar] [CrossRef
[7] Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Ville-na-Martinez, V. and Rodriguez, J.G. (2017) A Review on Deep Learning Techniques Applied to Semantic Segmenta-tion.
[8] Ku, J., Mozifian, M., Lee, J., et al. (2018) Joint 3D Proposal Generation and Object Detection from View Ag-gregation. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, Madrid, 1-5 October 2018, 1-8. [Google Scholar] [CrossRef
[9] Huang, H.B., Kalogerakis, E., Chaudhuri, S., et al. (2018) Learning Local Shape Descriptors from Part Correspondences with Multiview Convolutional Networks. ACM Transac-tions on Graphics (TOG), 37, 1-14. [Google Scholar] [CrossRef
[10] Wu, Z., Song, S., Khosla, A., et al. (2015) 3D ShapeNets: A Deep Repre-sentation for Volumetric Shapes. Proceedings of the IEEE Conference on Computer vision and Pattern Recognition, 2015, 1912-1920.
[11] Jiang, M., Wu, Y., Zhao, T., et al. (2018) PointSIFT: A SIFT-Like Network Module for 3D Point Cloud Semantic Segmentation.