激光雷达数据协助下的高光谱图像三维残差网络分类
3D Residual Network for Hyperspectral Image Classification Aided by LiDAR Data
DOI: 10.12677/CSA.2020.1012242, PDF,    国家自然科学基金支持
作者: 王 理, 赵艮平, 王卓薇, 程良伦:广东工业大学计算机学院,广东 广州;廖建尚:广东交通职业技术学院轨道交通学院,广东 广州
关键词: 深度学习高光谱图像激光雷达阴影效应光谱变异Deep Learning Hyperspectral Image LiDAR Shadow Effect Spectral Variability
摘要: 高光谱成像(Hyperspectral Imaging, HSI)数据可以在狭窄和连续的波段中收集数据,即使在差异很小的情况下,也可以检测到不同类别的数据。然而,光谱变异性和阴影效应会限制任何HSI的分类精度。与HSI相比,激光雷达数据(LiDAR)是HSI的一个很好的补充,因为它提供了高度信息和来自不同物体的多次回波数据。在激光雷达数据的辅助下,通过HSI分类的预处理和深度残差网络分类,可以有效解决阴影效应光谱变异性的问题。除此之外,来源于点云数据的数字高程模型(Digital Elevation Models, DEM)也能够提高HSI分类性能。通过在MUUFL港湾高光谱和激光雷达机载数据集上进行实验的结果表明,采用两种DEM栅格层结合HSI的分类准确率为98.16%,而仅采用HSI数据集独立学习方法的分类准确率为96.3%。并且随着精度的提高,标准偏差从0.304降低到0.150。
Abstract: Hyperspectral imaging (HSI) allows data to be collected in narrow and continuous wavebands, and even when the differences are small, different categories can be detected. However, spectral variability and shadow effects can limit the classification of any hyperspectral image. Compared with HSI, the LiDAR data is an excellent complement to HIS, because it provides both elevation information and multiple returns of echoes from different objects. A procedure including preprocessing and deep residual network classification is investigated for classification of HSI aided by the LiDAR data to solve the problem of identifying shaded objects and spectral variability. In addition, Digital Elevation Models (DEM) derived from point cloud data can also improve the performance of HSI classification. Experiments were performed on the MUUFL bay harbor hyperspectral and LiDAR airborne data sets. The results show that 98.16% classification accuracy was achieved when using two DEM raster layers combined with hyperspectral images, compared to 96.3% accuracy using independent learning methods derived from only the HSI data set. As the accuracy increased, the standard deviation decreased from 0.304 to 0.150. The former indicates that the effect of spectral variability is mitigated.
文章引用:王理, 赵艮平, 王卓薇, 程良伦, 廖建尚. 激光雷达数据协助下的高光谱图像三维残差网络分类[J]. 计算机科学与应用, 2020, 10(12): 2296-2305. https://doi.org/10.12677/CSA.2020.1012242

参考文献

[1] Lacar, F.M., Lewis, M.M. and Grierson, I.T. (2001) Use of Hyperspectral Reflectance for Discrimination between Grape Varieties. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium, Vol. 6, 2878-2880.
[2] Van Der Meer, F. (2004) Analysis of Spectral Absorption Features in Hyperspectral Imagery. International Journal of Applied Earth Observation and Geoinformation, 5, 55-68. [Google Scholar] [CrossRef
[3] Stuffler, T., Förster, K., Hofer, S., et al. (2009) Hyperspectral Imag-ing—An Advanced Instrument Concept for the EnMAP Mission (Environmental Mapping and Analysis Programme). Acta Astronautica, 65, 1107-1112. [Google Scholar] [CrossRef
[4] Samat, A., Li, J., Liu, S., et al. (2016) Improved Hyperspectral Image Classification by Active Learning Using Pre-Designed Mixed Pixels. Pattern Recognition, 51, 43-58. [Google Scholar] [CrossRef
[5] Plaza, A., Martinez, P., Perez, R., et al. (2004) A New Approach to Mixed Pixel Classification of Hyperspectral Imagery Based on Extended Morphological Profiles. Pattern Recognition, 37, 1097-1116. [Google Scholar] [CrossRef
[6] Keshava, N. and Mustard, J.F. (2002) Spectral Unmixing. IEEE Signal Processing Magazine, 19, 44-57. [Google Scholar] [CrossRef
[7] Villa, A., Benediktsson, J.A., Chanussot, J., et al. (2011) Hyperspectral Image Classification with Independent Component Discriminant Analysis. IEEE Transactions on Geoscience and Re-mote Sensing, 49, 4865-4876. [Google Scholar] [CrossRef
[8] Chen, Y., Zhao, X. and Jia, X. (2015) Spectral-Spatial Classifi-cation of Hyperspectral Data Based on Deep Belief Network. IEEE Journal of Selected Topics in Applied Earth Observa-tions and Remote Sensing, 8, 2381-2392. [Google Scholar] [CrossRef
[9] Matsuki, T., Yokoya, N. and Iwasaki, A. (2015) Hyperspec-tral Tree Species Classification of Japanese Complex Mixed Forest with the Aid of LiDAR Data. IEEE Journal of Se-lected Topics in Applied Earth Observations and Remote Sensing, 8, 2177-2187. [Google Scholar] [CrossRef
[10] Friman, O., Tolt, G. and Ahlberg, J. (2011) Illumination and Shadow Compensation of Hyperspectral Images Using a Digital Surface Model and Non-Linear Least Squares Estima-tion. Image and Signal Processing for Remote Sensing XVII, Vol. 8180, 81800Q. [Google Scholar] [CrossRef
[11] Debes, C., Merentitis, A., Heremans, R., et al. (2014) Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7, 2405-2418. [Google Scholar] [CrossRef
[12] Sankey, T., Donager, J., McVay, J., et al. (2017) UAV Lidar and Hyperspectral Fusion for Forest Monitoring in the Southwestern USA. Remote Sensing of Environment, 195, 30-43. [Google Scholar] [CrossRef
[13] Dalponte, M., Bruzzone, L. and Gianelle, D. (2008) Fusion of Hy-perspectral and LIDAR Remote Sensing Data for Classification of Complex Forest Areas. IEEE Transactions on Geo-science and Remote Sensing, 46, 1416-1427. [Google Scholar] [CrossRef
[14] He, K. and Sun, J. (2015) Convolutional Neural Networks at Constrained Time Cost. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, 7-12 June 2015, 5353-5360. [Google Scholar] [CrossRef
[15] He, K., Zhang, X., Ren, S., et al. (2016) Deep Residual Learn-ing for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Ve-gas, 27-30 June 2016, 770-778. [Google Scholar] [CrossRef
[16] Zhao, C., Zhao, G. and Jia, X. (2016) Hyperspectral Image Unmixing Based on Fast Kernel Archetypal Analysis. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 10, 331-346. [Google Scholar] [CrossRef
[17] Zhao, W. and Du, S. (2016) Spectral-Spatial Feature Extrac-tion for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach. IEEE Transactions on Geoscience and Remote Sensing, 54, 4544-4554. [Google Scholar] [CrossRef
[18] Li, W., Wu, G., Zhang, F., et al. (2016) Hyperspectral Image Classification Using Deep Pixel-Pair Features. IEEE Transactions on Geoscience and Remote Sensing, 55, 844-853. [Google Scholar] [CrossRef
[19] Chen, Y., Jiang, H., Li, C., et al. (2016) Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks. IEEE Transactions on Geoscience and Remote Sensing, 54, 6232-6251. [Google Scholar] [CrossRef
[20] Zhong, Z., Li, J., Luo, Z., et al. (2017) Spectral-Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework. IEEE Transactions on Geoscience and Remote Sensing, 56, 847-858. [Google Scholar] [CrossRef
[21] Mørup, M. and Hansen, L.K. (2010) Archetypal Analysis for Machine Learning. 2010 IEEE International Workshop on Machine Learning for Signal Processing, Espoo, 21-24 Sep-tember 2020, 172-177. [Google Scholar] [CrossRef
[22] McCallum, D. and Avis, D. (1979) A Linear Algorithm for Finding the Convex Hull of a Simple Polygon. Information Processing Letters, 9, 201-206. [Google Scholar] [CrossRef
[23] Dwyer, R.A. (1988) On the Convex Hull of Random Points in a Polytope. Journal of Applied Probability, 25, 688-699. [Google Scholar] [CrossRef
[24] Cutler, A. and Breiman, L. (1994) Archetypal Analysis. Technometrics, 36, 338-347. [Google Scholar] [CrossRef
[25] Gader, P., Zare, A., Close, R., Aitken, J. and Tuell, G. (2013) MUUFL Gulfport Hyperspectral and LiDAR Airborne Data Set. University of Florida, Gainesville, Tech. Rep. REP-2013-570.