基于目标检测的海上舰船图像超分辨率研究
Research on Super-Resolution of Marine Ship Image Based on Target Detection
摘要: 针对海上舰船图像有效像素在整体像素中占比小的问题，提出一种基于目标检测网络的超分辨率方法。该方法包含两个阶段，结合bicubic变换，逐步地将图像的清晰度从粗到细地进行恢复。首先，第一阶段通过目标检测网络，检测出原图像中需要超分辨率的区域，然后，第二阶段将对应区域通过bicubic变换调整至指定分辨率，而后通过生成对抗网络增强图像细节。最终在自建数据集上的实验结果表明，与传统方法和现有基于深度神经网路的超分辨率重建算法相比，该算法不仅图像视觉效果最好，而且在数据集上的峰值信噪比(PSNR)平均提高了0.79 dB，结构相似性(SSIM)平均提高了0.04，证明了该算法的有效性。
Abstract: Aiming at the problem that the effective pixels in the image of marine ships account for a small proportion in the total pixels, a super-resolution method based on target detection network is proposed. The method consists of two stages, combining with the bicubic transform, to restore the sharpness of the image from coarse to fine step by step. Firstly, in the first stage, super-resolution regions in the original image are detected through the target detection network. Then, in the se-cond stage, the corresponding regions are adjusted to the specified resolution by bicubic trans-formation, and then the image details are enhanced by generating the countermeasure network. Finally, the experimental results on the self-built dataset show that compared with the traditional method and the existing super-resolution reconstruction algorithm based on deep neural network, this algorithm not only has the best visual effect, but also improves the peak signal-to-noise ratio (PSNR) of the dataset by an average of 0.79 dB and the structural similarity (SSIM) by an average of 0.04, which proves the effectiveness of the algorithm.
文章引用：张坤, 李天伟. 基于目标检测的海上舰船图像超分辨率研究[J]. 图像与信号处理, 2019, 8(3): 121-129. https://doi.org/10.12677/JISP.2019.83017

参考文献

[1] 李欣, 崔子冠, 朱秀昌. 超分辨率重建算法综述[J]. 电视技术, 2016, 40(9): 1-9.
[2] Glasner, D., Bagon, S. and Irani, M. (2009) Super-Resolution from a Single Image. In: Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, IEEE, Piscataway, 349-356.
[Google Scholar] [CrossRef] 
[3] 郑伟成. 基于深度学习的目标检测算法综述[C]//中国计算机用户协会网络应用分会. 中国计算机用户协会网络应用分会2018年第二十二届网络新技术与应用年会论文集. 北京: 中国计算机用户协会网络应用分会, 北京联合大学北京市信息服务工程重点实验室, 2018: 5.
[4] Redmon, J., Divvala, S., Girshick, R., et al. (2015) You Only Look Once: Unified, Real-Time Object Detection. Proceedings of CVPR 2015, Boston, 7-12 June 2015, 779-788.
[Google Scholar] [CrossRef] 
[5] Zhong, Z., Jin, L. and Xie, Z. (2015) High Performance off Line Handwritten Chinese Character Recognition Using Google Net and Directional Feature Maps. International Conference on Document Analysis and Recognition, Nancy, 23-26 August 2015, 846-850.
[Google Scholar] [CrossRef] 
[6] 南方哲, 钱育蓉, 行艳妮, 赵京霞. 基于深度学习的单图像超分辨率重建研究综述[J/OL]. 计算机应用研究, 1-7. http://kns.cnki.net/kcms/detail/51.1196.TP.20181219.1953.003.html, 2019-04-03.
[7] Dong, C., Loy, C.C., He, K., et al. (2014) Learning a Deep Convolutional Network for Image Super-Resolution. In: Computer Vision ECCV 2014, Springer International Pub-lishing, Berlin, 184-199.
[Google Scholar] [CrossRef] 
[8] Ledig, C., Theis, L., Huszar, F., et al. (2016) Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 105-114.
[Google Scholar] [CrossRef] 
[9] Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A. and Bengio, Y. (2014) Generative Adversarial Nets. In: Advances in Neural Information Processing Systems, The MIT Press, Cambridge, 2672-2680.
[10] Isola, P., Zhu, J.Y., Zhou, T., et al. (2016) Image-to-Image Translation with Conditional Adver-sarial Networks. Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 5967-5976.
[Google Scholar] [CrossRef] 
[11] Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation.
[12] Li, C. and Wand, M. (2016) Pre-Computed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks. European Conference on Computer Vision, Amsterdam, 8-16 October 2016, 702-716.
[Google Scholar] [CrossRef] 
[13] Keys, R. (2003) Cubic Convolution Interpolation for Digital Image Pro-cessing. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29, 1153-1160.
[Google Scholar] [CrossRef] 
[14] Kim, T. (2017) Learning to Discover Cross-Domain Relations with Gener-ative Adversarial Networks.
[15] 杨庆怡, 黄灿, 张琼. 基于POCS算法的超分辨率图像重建技术[J]. 计算机光盘软件与应用, 2012(16): 61-62.