基于特征聚合的深度霍夫变换法向估计算法
Deep Hough Transform Normal Estimation Algorithm Based on Feature Aggregation
DOI: 10.12677/aam.2024.1311466, PDF,    国家自然科学基金支持
作者: 刘晓渝*, 李佳琪, 丁兮乔:辽宁师范大学数学学院,辽宁 大连
关键词: 法向估计深度霍夫变换特征聚合卷积神经网络Normal Estimation Deep Hough Transform Feature Aggregation Convolutional Neural Network
摘要: 在点云处理过程中,法向估计是非常重要的一步。现有的深度霍夫变换的法向估计网络通过对点云进行霍夫变换得到邻域特征,再将其输入至卷积神经网络中学习估计法向。但由于霍夫变换过程中存在一定信息损失导致最后所得法向不准确,效果不够理想。对此,本文先通过霍夫变换将法向空间与二维平面相对应,并将二维空间离散化获得所有潜在切平面,设计特征聚合将点特征转化为潜在切平面特征作为CNN输入来降低霍夫变换过程中信息的损失,从而提升卷积神经网络的输入,进而提升网络整体的法向估计质量。实验结果表明,由此产生的法向估计网络的整体性能有所提升,对于不同噪声尺度也更具鲁棒性。
Abstract: In the process of point cloud processing, normal estimation is a very important step. The existing normal estimation network of deep Hough transform obtains neighborhood features by performing Hough transform on the point cloud and then inputs them into a convolutional neural network to learn and estimate the normal. However, due to certain information loss in the Hough transform process, the finally obtained normal is inaccurate and the effect is not ideal. In response to this, this paper first corresponds the normal space to a two-dimensional plane through Hough transform, and discretizes the two-dimensional space to obtain all potential tangent planes. Feature aggregation is designed to transform point features into potential tangent plane features as the input of CNN to reduce the information loss in the Hough transform process, thereby enhancing the input of the convolutional neural network and further improving the overall normal estimation quality of the network. Experimental results show that the overall performance of the resulting normal estimation network is improved, and it is also more robust to different noise scales.
文章引用:刘晓渝, 李佳琪, 丁兮乔. 基于特征聚合的深度霍夫变换法向估计算法[J]. 应用数学进展, 2024, 13(11): 4845-4854. https://doi.org/10.12677/aam.2024.1311466

参考文献

[1] Schnabel, R., Wahl, R. and Klein, R. (2007) Efficient RANSAC for Point‐cloud Shape Detection. Computer Graphics Forum, 26, 214-226. [Google Scholar] [CrossRef
[2] Wang, S., Cai, G., Cheng, M., Marcato Junior, J., Huang, S., Wang, Z., et al. (2020) Robust 3D Reconstruction of Building Surfaces from Point Clouds Based on Structural and Closed Constraints. ISPRS Journal of Photogrammetry and Remote Sensing, 170, 29-44. [Google Scholar] [CrossRef
[3] Qi, C.R., Liu, W., Wu, C., Su, H. and Guibas, L.J. (2018) Frustum PointNets for 3D Object Detection from RGB-D Data. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 918-927. [Google Scholar] [CrossRef
[4] Rusinkiewicz, S. and Levoy, M. (2000) QSplat: A Multiresolution Rendering System for Large Meshes. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, 23-28 July 2000, 343-352. [Google Scholar] [CrossRef
[5] Amenta, N. and Bern, M. (1999) Surface Reconstruction by Voronoi Filtering. Discrete & Computational Geometry, 22, 481-504. [Google Scholar] [CrossRef
[6] Alliez, P., Cohen-Steiner, D., Tong, Y., et al. (2007) Voronoi-Based Variational Reconstruction of Unoriented Point Sets. Proceedings of the Fifth Eurographics Symposium on Geometry Processing, Barcelona, 4-6 July 2007, 39-48.
[7] Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Levin, D. and Silva, C.T. (2001) Point set surfaces. Proceedings Visualization, 2001. VIS’01, San Diego, 1-26 October 2001, 21-29, 537. [Google Scholar] [CrossRef
[8] Calderon, F., Ruiz, U. and Rivera, M. (2007) Surface-Normal Estimation with Neighborhood Reorganization for 3D Reconstruction. In: Rueda, L., Mery, D. and Kittler, J., Eds., Progress in Pattern Recognition, Image Analysis and Applications, Springer Berlin Heidelberg, 321-330. [Google Scholar] [CrossRef
[9] Öztireli, A.C., Guennebaud, G. and Gross, M. (2009) Feature Preserving Point Set Surfaces Based on Non‐Linear Kernel Regression. Computer Graphics Forum, 28, 493-501. [Google Scholar] [CrossRef
[10] Jones, T.R., Durand, F. and Zwicker, M. (2004) Normal Improvement for Point Rendering. IEEE Computer Graphics and Applications, 24, 53-56. [Google Scholar] [CrossRef] [PubMed]
[11] Hoppe, H., DeRose, T., Duchamp, T., McDonald, J. and Stuetzle, W. (1992) Surface Reconstruction from Unorganized Points. ACM SIGGRAPH Computer Graphics, 26, 71-78. [Google Scholar] [CrossRef
[12] Mitra, N.J., Nguyen, A. and Guibas, L. (2004) Estimating Surface Normals in Noisy Point Cloud Data. International Journal of Computational Geometry & Applications, 14, 261-276. [Google Scholar] [CrossRef
[13] Huang, H., Li, D., Zhang, H., Ascher, U. and Cohen-Or, D. (2009) Consolidation of Unorganized Point Clouds for Surface Reconstruction. ACM Transactions on Graphics, 28, 1-7. [Google Scholar] [CrossRef
[14] Zhang, J., Cao, J., Liu, X., Wang, J., Liu, J. and Shi, X. (2013) Point Cloud Normal Estimation via Low-Rank Subspace Clustering. Computers & Graphics, 37, 697-706. [Google Scholar] [CrossRef
[15] Liu, X., Zhang, J., Cao, J., Li, B. and Liu, L. (2015) Quality Point Cloud Normal Estimation by Guided Least Squares Representation. Computers & Graphics, 51, 106-116. [Google Scholar] [CrossRef
[16] Boulch, A. and Marlet, R. (2012) Fast and Robust Normal Estimation for Point Clouds with Sharp Features. Computer Graphics Forum, 31, 1765-1774. [Google Scholar] [CrossRef
[17] Boulch, A. and Marlet, R. (2016) Deep Learning for Robust Normal Estimation in Unstructured Point Clouds. Computer Graphics Forum, 35, 281-290. [Google Scholar] [CrossRef
[18] Zhao, K., Han, Q., Zhang, C.B., Xu, J. and Cheng, M.M. (2022) Deep Hough Transform for Semantic Line Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 4793-4806.
[19] Penedones, H., Collobert, R. and Fleuret, F. (2012) Improving Object Classification Using Pose Information. IDIAP Research Reports.
[20] Qi, C.R., Su, H., Mo, K., et al. (2017) PointNet: Deep Learning on Point Sets for 3d Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 652-660.
[21] Guerrero, P., Kleiman, Y., Ovsjanikov, M. and Mitra, N.J. (2018) PCPNET Learning Local Shape Properties from Raw Point Clouds. Computer Graphics Forum, 37, 75-85. [Google Scholar] [CrossRef
[22] Zhu, R., Liu, Y., Dong, Z., Wang, Y., Jiang, T., Wang, W., et al. (2021) AdaFit: Rethinking Learning-Based Normal Estimation on Point Clouds. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 6098-6107. [Google Scholar] [CrossRef
[23] Ben-Shabat, Y. and Gould, S. (2020) DeepFit: 3D Surface Fitting via Neural Network Weighted Least Squares. In: Vedaldi, A., Bischof, H., Brox, T. and Frahm, J.M., Eds., Computer VisionECCV 2020, Springer International Publishing, 20-34. [Google Scholar] [CrossRef