基于迁移学习的大规模遥感图像语义分割与提取
Semantic Segmentation and Extraction of Large Scale Remote Sensing Images Based on Transfer Learning
DOI: 10.12677/AAM.2022.116403, PDF,   
作者: 袁 月:上海理工大学理学院,上海;汪鹏飞, 胡志淘:南京大学电子科学与工程学院,江苏 南京
关键词: 遥感图像语义分割特征融合迁移学习卷积神经网络Remote Sensing Image Semantic Segmentation Feature Fusion Transfer Learning Convolutional Neural Network
摘要: 图像语义分割是计算机视觉领域的热点研究课题,随着全卷积神经网络的迅速兴起,图像语义分割和全卷积神经网络的融合发展取得了快速发展。本文建立了基于特征融合的大规模卷积神经网络语义分割训练模型。通过迁移学习的监督式训练方式,对目前图像分割领域主流的模型进行了训练与比较,建立了评估指标PR参数以及预测图像的噪声分析模型。在训练模型时将其分成两个分支,利用主流的语义分割模型特性,分别做降噪分支和提取空间语义分支等,引入采集源高度作为权重参数,对不同分支进行特征融合,以提高其鲁棒性。最后进行特征融合,借助机器学习完成遥感图像分割任务并对本文模型的有效性进行验证。
Abstract: Image semantic segmentation is a hot research topic in the field of computer vision. With the rapid rise of fully convolutional neural networks, the fusion of image semantic segmentation and fully convolutional neural networks has achieved rapid development. In this paper, a large-scale convo-lutional neural network semantic segmentation training model based on feature fusion is estab-lished. Through the supervised training method of transfer learning, the current mainstream mod-els in the field of image segmentation are trained and compared, and the evaluation index PR pa-rameters and the noise analysis model of the predicted image are established. When training the model, it is divided into two branches, using the characteristics of mainstream semantic segmenta-tion models to do noise reduction branch and extraction spatial semantic branch, etc., and intro-ducing the height of the acquisition source as a weight parameter, and perform feature fusion on different branches to improve its robustness. Finally, feature fusion is performed, the remote sens-ing image segmentation task is completed with the help of machine learning and the effectiveness of the model in this paper is verified.
文章引用:袁月, 汪鹏飞, 胡志淘. 基于迁移学习的大规模遥感图像语义分割与提取[J]. 应用数学进展, 2022, 11(6): 3753-3765. https://doi.org/10.12677/AAM.2022.116403

参考文献

[1] 余帅, 汪西莉. 含多级通道注意力机制的CGAN遥感图像建筑物分割[J]. 中国图象图形学报, 2021, 26(3): 686-699.
[2] Yang, G., Zhang, Q. and Zhang, G. (2020) EANet: Edge-Aware Network for the Extraction of Buildings from Aerial Images. Remote Sensing, 12, Article No. 2161. [Google Scholar] [CrossRef
[3] 季顺平, 魏世清. 遥感影像建筑物提取的卷积神经元网络与开源数据集方法[J]. 测绘学报, 2019, 48(4): 448-459.
[4] 朱明胜. 图像增强技术研究与实现[D]: [硕士学位论文]. 合肥: 安徽大学, 2014.
[5] 邓仕超, 黄寅. 二值图像膨胀腐蚀的快速算法[J]. 计算机工程与应用, 2017, 53(5): 207-211.
[6] 张刚. 基于深度学习的遥感图像语义分割关键技术研究[D]: [博士学位论文]. 成都: 中国科学院大学(中国科学院光电技术研究所), 2020.
[7] Lu, Y., Chen, Y., Zhao, D., et al. (2019) Graph-FCN for Image Semantic Segmentation. In: Cham, Ed., Advances in Neural Networks, Springer, Berlin, 97-105. [Google Scholar] [CrossRef
[8] Long, J., Shelhamer, E. and Darrell, T. (2015) Fully Convolutional Networks for Semantic Segmentation. 2015 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Boston, 7-12 June 2015, 3431-3440. [Google Scholar] [CrossRef
[9] Chen, L.C., Papandreou, G., Kokkinos, I., et al. (2018) DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848. [Google Scholar] [CrossRef
[10] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, 5-9 October 2015, 234-241. [Google Scholar] [CrossRef
[11] 王健宗, 孔令炜, 黄章成, 肖京. 图神经网络综述[J]. 计算机工程, 2021, 47(4): 1-12.
[12] 徐文娜. 基于高分辨率全卷积网络的遥感影像耕地提取方法研究[D]: [硕士学位论文]. 深圳: 中国科学院大学(中国科学院深圳先进技术研究院), 2020.
[13] Pan, S.J. and Yang, Q. (2010) A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 22, 1345-1359. [Google Scholar] [CrossRef
[14] Wu, Y.X. and He, K.M. (2018) Group Normalization. International Journal of Computer Vision, 128, 742-755. [Google Scholar] [CrossRef
[15] Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., et al. (2018) A survey on Deep Learning Techniques for Image and Video Semantic Segmentation. Applied Soft Computing, 70, 41-65. [Google Scholar] [CrossRef
[16] Zhang, W., Li, R., Deng, H., et al. (2015) Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation. NeuroImage, 108, 214-224. [Google Scholar] [CrossRef] [PubMed]