SSCST-Net:基于空谱通道选择和Transformer的高光谱图像分类模型
SSCST-Net: Hyperspectral Image Classification Model Based on Spatial-Spectral Channel Selection and Transformer
DOI: 10.12677/mos.2025.145415, PDF,   
作者: 傅彬涛:上海理工大学光电信息与计算机工程学院,上海
关键词: 高光谱图像分类空谱通道选择TransformerHyperspectral Image Classification Spatial-Spectral Channel Selection Transformer
摘要: 近年来,基于Transformer的深度学习模型在高光谱图像分类任务中取得了显著的性能提高,但是由于高光谱图像具有丰富且连续的光谱特征,不可避免地存在光谱特征冗余问题,从而导致分类精度下降,同时Transformer对局部空间特征的提取存在一定的改善空间。为此,文章提出了一种基于空谱通道选择和Transformer的高光谱图像分类网络。首先,利用自适应的空谱通道选择方法来提取类别边缘特征,并保留具有高度类别特征表达能力的光谱通道,从而解决Transformer对局部空间特征关注不足和特征冗余的问题,再利用Transformer来提取空间光谱特征并进行分类。实验结果表明,该模型在Indian Pines和University of Pavia上分别取得98.45%和99.62%的整体分类精度。
Abstract: In recent years, Transformer-based deep learning models have achieved remarkable performance improvements in hyperspectral image classification tasks. However, due to the rich and continuous spectral characteristics of hyperspectral images, spectral feature redundancy inevitably exists, leading to reduced classification accuracy. Additionally, Transformer architecture still has room for improvement in extracting local spatial features. To address these issues, this paper proposes a hyperspectral image classification network based on spatial-spectral channel selection and Transformer. First, an adaptive spatial-spectral channel selection method is employed to extract class-discriminative edge features while preserving spectral channels with high class-specific representational capacity. This approach mitigates both the insufficient attention to local spatial features in the Transformer and the feature redundancy problem. Subsequently, the Transformer is utilized to capture spatial-spectral features for classification. Experimental results demonstrate that the proposed model achieves overall classification accuracies of 98.45% and 99.62% on the Indian Pines and University of Pavia datasets, respectively.
文章引用:傅彬涛. SSCST-Net:基于空谱通道选择和Transformer的高光谱图像分类模型[J]. 建模与仿真, 2025, 14(5): 569-578. https://doi.org/10.12677/mos.2025.145415

参考文献

[1] Yan, Y., Ren, J., Tschannerl, J., Zhao, H., Harrison, B. and Jack, F. (2021) Nondestructive Phenolic Compounds Measurement and Origin Discrimination of Peated Barley Malt Using Near-Infrared Hyperspectral Imagery and Machine Learning. IEEE Transactions on Instrumentation and Measurement, 70, 1-15. [Google Scholar] [CrossRef
[2] Fox, N., Parbhakar-Fox, A., Moltzen, J., Feig, S., Goemann, K. and Huntington, J. (2017) Applications of Hyperspectral Mineralogy for Geoenvironmental Characterisation. Minerals Engineering, 107, 63-77. [Google Scholar] [CrossRef
[3] Zare, A., Jiao, C. and Glenn, T. (2018) Discriminative Multiple Instance Hyperspectral Target Characterization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 2342-2354. [Google Scholar] [CrossRef] [PubMed]
[4] Zabalza, J., Ren, J., Yang, M., Zhang, Y., Wang, J., Marshall, S., et al. (2014) Novel Folded-PCA for Improved Feature Extraction and Data Reduction with Hyperspectral Imaging and SAR in Remote Sensing. ISPRS Journal of Photogrammetry and Remote Sensing, 93, 112-122. [Google Scholar] [CrossRef
[5] Bandos, T.V., Bruzzone, L. and Camps-Valls, G. (2009) Classification of Hyperspectral Images with Regularized Linear Discriminant Analysis. IEEE Transactions on Geoscience and Remote Sensing, 47, 862-873. [Google Scholar] [CrossRef
[6] Hu, W., Huang, Y., Wei, L., Zhang, F. and Li, H. (2015) Deep Convolutional Neural Networks for Hyperspectral Image Classification. Journal of Sensors, 2015, Article ID: 258619.
[7] Zhao, W. and Du, S. (2016) Learning Multiscale and Deep Representations for Classifying Remotely Sensed Imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 113, 155-165. [Google Scholar] [CrossRef
[8] Chen, Y., Jiang, H., Li, C., Jia, X. and Ghamisi, P. (2016) Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks. IEEE Transactions on Geoscience and Remote Sensing, 54, 6232-6251. [Google Scholar] [CrossRef
[9] Luo, F., Du, B., Zhang, L., Zhang, L. and Tao, D. (2019) Feature Learning Using Spatial-Spectral Hypergraph Discriminant Analysis for Hyperspectral Image. IEEE Transactions on Cybernetics, 49, 2406-2419. [Google Scholar] [CrossRef] [PubMed]
[10] Lu, T., Li, S., Fang, L., Bruzzone, L. and Benediktsson, J.A. (2016) Set-to-Set Distance-Based Spectral-Spatial Classification of Hyperspectral Images. IEEE Transactions on Geoscience and Remote Sensing, 54, 7122-7134. [Google Scholar] [CrossRef
[11] Ji, L., Wang, L. and Geng, X. (2019) An Automatic Bad Band Pre-Removal Method for Hyperspectral Imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12, 4985-4994. [Google Scholar] [CrossRef
[12] Yang, X., Ye, Y., Li, X., Lau, R.Y.K., Zhang, X. and Huang, X. (2018) Hyperspectral Image Classification with Deep Learning Models. IEEE Transactions on Geoscience and Remote Sensing, 56, 5408-5423. [Google Scholar] [CrossRef
[13] Yue, J., Zhao, W., Mao, S. and Liu, H. (2015) Spectral-Spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks. Remote Sensing Letters, 6, 468-477. [Google Scholar] [CrossRef
[14] Roy, S.K., Krishna, G., Dubey, S.R. and Chaudhuri, B.B. (2020) HybridSN: Exploring 3-D-2-D CNN Feature Hierarchy for Hyperspectral Image Classification. IEEE Geoscience and Remote Sensing Letters, 17, 277-281. [Google Scholar] [CrossRef
[15] Hong, D., Han, Z., Yao, J., Gao, L., Zhang, B., Plaza, A., et al. (2022) Spectralformer: Rethinking Hyperspectral Image Classification with Transformers. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-15. [Google Scholar] [CrossRef
[16] Mei, S., Song, C., Ma, M. and Xu, F. (2022) Hyperspectral Image Classification Using Group-Aware Hierarchical Transformer. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-14. [Google Scholar] [CrossRef