融合频域增强的遥感图像超分辨率重建方法
Remote Sensing Image Super-Resolution Reconstruction Method Enhanced by Frequency Domain Fusion
DOI: 10.12677/sea.2026.153042, PDF,   
作者: 卢昌婷, 梁玉琦*:兰州交通大学,光电技术与智能控制教育部重点实验室,甘肃 兰州;兰州交通大学,国家绿色镀膜技术与装备工程技术研究中心,甘肃 兰州
关键词: 遥感图像超分辨率重建频域增强RRDBNet高频信息频域一致性损失Remote Sensing Image Super-Resolution Reconstruction Frequency-Domain Enhancement RRDBNet High-Frequency Information Frequency-Domain Consistency Loss
摘要: 现有遥感图像超分辨率重建方法在主体结构恢复方面取得了一定效果,但仍存在高频信息利用不足、边缘易模糊以及复杂纹理区域细节恢复不充分等问题。提出一种融合频域增强的遥感图像超分辨率重建方法(Frequency-Enhanced Prior Reconstruction, FEPR)。该方法以RRDBNet为主干网络,在深层特征融合阶段引入频域增强模块,通过统计特征频谱中的高频响应并进行通道自适应重标定,增强网络对边缘、纹理及局部高频结构的表征能力;同时结合像素重建损失与频域一致性损失进行联合监督,以提升重建结果在空间域和频域上的一致性。在NWPU-RESISC45、AID、UC Merced Land Use和WHU-RS19等公开遥感数据集上的实验结果表明,所提方法在不同数据集和放大倍率条件下均取得了较为稳定的重建效果。其中,在NWPU-RESISC45数据集×4任务上,FEPR取得25.52 dB的PSNR和0.6345的SSIM,SSIM优于EDSR和RCAN。消融实验表明,频域增强模块与频域一致性损失对提升重建性能具有一定作用。
Abstract: Existing remote sensing image super-resolution reconstruction methods have achieved certain effects in the restoration of main structures, but there are still problems such as insufficient utilisation of high-frequency information, edge blurring, and inadequate detail recovery in complex texture areas. A remote sensing image super-resolution reconstruction method with frequency-domain enhancement (Frequency-Enhanced Prior Reconstruction, FEPR) is proposed. This method uses RRDBNet as the backbone network and introduces a frequency-domain enhancement module during the deep feature fusion stage to enhance the network’s ability to represent edges, textures, and local high-frequency structures by statistically analysing high-frequency responses in the feature spectrum and performing channel adaptive recalibration. Meanwhile, a combination of pixel reconstruction loss and frequency-domain consistency loss is used for joint supervision to improve the consistency of the reconstruction results in both spatial and frequency domains. Experimental results on publicly available remote sensing datasets such as NWPU-RESISC45, AID, UC Merced Land Use, and WHU-RS19 show that the proposed method achieves relatively stable reconstruction performance under different datasets and scale factors. Notably, in the ×4 task on the NWPU-RESISC45 dataset, FEPR achieved a PSNR of 25.52 dB and an SSIM of 0.6345, with SSIM outperforming EDSR and RCAN. Ablation experiments indicate that the frequency-domain enhancement module and frequency-domain consistency loss play a certain role in improving reconstruction performance.
文章引用:卢昌婷, 梁玉琦. 融合频域增强的遥感图像超分辨率重建方法[J]. 软件工程与应用, 2026, 15(3): 445-455. https://doi.org/10.12677/sea.2026.153042

参考文献

[1] 成科扬, 荣兰, 蒋森林, 等. 基于深度学习的遥感图像超分辨率重建方法综述[J]. 郑州大学学报(工学版), 2022, 43(5): 8-16.
[2] Lepcha, D.C., Goyal, B., Dogra, A. and Goyal, V. (2023) Image Super-Resolution: A Comprehensive Review, Recent Trends, Challenges and Applications. Information Fusion, 91, 230-260. [Google Scholar] [CrossRef
[3] Dong, C., Loy, C.C., He, K. and Tang, X. (2016) Image Super-Resolution Using Deep Convolutional Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 295-307. [Google Scholar] [CrossRef] [PubMed]
[4] Kim, J., Lee, J.K. and Lee, K.M. (2016) Accurate Image Super-Resolution Using Very Deep Convolutional Networks. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 27-30 June 2016, 1646-1654. [Google Scholar] [CrossRef
[5] Lim, B., Son, S., Kim, H., Nah, S. and Lee, K.M. (2017) Enhanced Deep Residual Networks for Single Image Super-resolution. 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, 21-26 July 2017, 136-144. [Google Scholar] [CrossRef
[6] Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B. and Fu, Y. (2018) Image Super-Resolution Using Very Deep Residual Channel Attention Networks. In: Ferrari, V., Hebert, M., Sminchisescu, C. and Weiss, Y., Eds., Lecture Notes in Computer Science, Springer International Publishing, 294-310. [Google Scholar] [CrossRef
[7] Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., et al. (2017) Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 4681-4690. [Google Scholar] [CrossRef
[8] Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., et al. (2019) ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. In: Leal-Taixé, L. and Roth, S., Eds., Lecture Notes in Computer Science, Springer International Publishing, 63-79. [Google Scholar] [CrossRef
[9] Dong, X., Wang, L., Sun, X., Jia, X., Gao, L. and Zhang, B. (2021) Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks. IEEE Transactions on Geoscience and Remote Sensing, 59, 3473-3485. [Google Scholar] [CrossRef
[10] Dong, X., Sun, X., Jia, X., Xi, Z., Gao, L. and Zhang, B. (2021) Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks. IEEE Transactions on Geoscience and Remote Sensing, 59, 1618-1633. [Google Scholar] [CrossRef
[11] Liu, Z., Feng, R., Wang, L., Zhong, Y., Zhang, L. and Zeng, T. (2022) Remote Sensing Image Super-Resolution via Dilated Convolution Network with Gradient Prior. IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, 17-22 July 2022, 2402-2405. [Google Scholar] [CrossRef
[12] Yao, P., He, P., Cheng, S., Fu, L., Guo, Z. and Zhao, J. (2022) Dynamic Multi-Scale Network for Remote Sensing Image Super-Resolution. IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, 17-22 July 2022, 3766-3769. [Google Scholar] [CrossRef
[13] Jia, S., Wang, Z., Li, Q., Jia, X. and Xu, M. (2022) Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-15. [Google Scholar] [CrossRef
[14] Dong, X., Xi, Z., Sun, X. and Yang, L. (2020) Remote Sensing Image Super-Resolution via Enhanced Back-Projection Networks. IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, 26 September 2020-2 October 2020, 1480-1483. [Google Scholar] [CrossRef
[15] Li, J., Fang, F., Mei, K. and Zhang, G. (2018) Multi-Scale Residual Network for Image Super-Resolution. In: Ferrari, V., Hebert, M., Sminchisescu, C. and Weiss, Y., Eds., Lecture Notes in Computer Science, Springer International Publishing, 527-542. [Google Scholar] [CrossRef
[16] Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A.P., Bishop, R., et al. (2016) Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 27-30 June 2016, 1874-1883. [Google Scholar] [CrossRef
[17] Xu, K., Qin, M., Sun, F., et al. (2020) Learning in the Frequency Domain. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 13-19 June 2020, 1740-1749.
[18] Zhao, H., Gallo, O., Frosio, I. and Kautz, J. (2017) Loss Functions for Image Restoration with Neural Networks. IEEE Transactions on Computational Imaging, 3, 47-57. [Google Scholar] [CrossRef
[19] Fuoli, D., Van Gool, L. and Timofte, R. (2021) Fourier Space Losses for Efficient Perceptual Image Super-Resolution. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 2360-2369. [Google Scholar] [CrossRef
[20] Keys, R. (1981) Cubic Convolution Interpolation for Digital Image Processing. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29, 1153-1160. [Google Scholar] [CrossRef