基于少样本学习的图像修复技术综述
A Review of Image Inpainting and Restoration Based on Few-Shot Learning
DOI: 10.12677/airr.2026.152048, PDF,   
作者: 王永超, 曹 鹏*:北京印刷学院信息工程学院,北京
关键词: 图像修复深度学习GAN少样本学习微调Image Inpainting Deep Learning GAN Few-Shot Learning Fine-Tuning
摘要: 针对图像修复任务中普遍存在的数据获取难及退化模式复杂多变等挑战,少样本学习为模型在新场景下的快速泛化与适应提供了新思路。本文系统梳理了该领域的最新研究进展:首先探讨了元学习如何通过优化初始化策略实现对新任务的快速参数适配;其次分析了生成先验如何利用预训练模型的潜在空间,在极低样本下重构高频细节;同时阐述了自监督与对比学习如何挖掘数据内部相关性以增强表征稳健性,以及迁移学习如何将大规模域外知识有效映射至特定修复任务。尽管现有方法在纹理一致性与结构复原上取得显著突破,但仍受限于过拟合风险、未知退化建模及推理效率等瓶颈。展望未来,模型的高效微调及持续增量学习将是突破当前局限的关键方向。
Abstract: Research on few-shot learning-based image inpainting and restoration aims to tackle the challenges of completion and recovery under data scarcity and highly variable degradation distributions, thereby improving a model’s generalization and rapid adaptation to new scenarios. This review summarizes recent advances, covering meta-learning approaches that enable fast parameter adaptation with only a few samples; generative-prior methods that reconstruct fine details from extremely limited data; self-supervised and contrastive learning that enhance training stability via internal pseudo-supervision and representation constraints; and transfer learning that leverages pretrained knowledge and auxiliary-domain data for cross-domain adaptation. These methods have improved texture consistency, structural integrity, and perceptual realism, yet they still face challenges in controlling overfitting, modeling unseen degradations, selecting appropriate evaluation metrics, and achieving efficient inference. Finally, we highlight unified modeling of multiple degradations, efficient adaptation of foundation models, and continual/incremental learning as key future directions.
文章引用:王永超, 曹鹏. 基于少样本学习的图像修复技术综述[J]. 人工智能与机器人研究, 2026, 15(2): 490-501. https://doi.org/10.12677/airr.2026.152048

参考文献

[1] Su, J., Xu, B. and Yin, H. (2022) A Survey of Deep Learning Approaches to Image Restoration. Neurocomputing, 487, 46-65. [Google Scholar] [CrossRef
[2] Liu, D., Wen, B., Liu, X., Wang, Z. and Huang, T. (2018) When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, 13-19 July 2018, 842-848. [Google Scholar] [CrossRef
[3] Zhang, K., Zuo, W., Chen, Y., Meng, D. and Zhang, L. (2017) Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Transactions on Image Processing, 26, 3142-3155. [Google Scholar] [CrossRef] [PubMed]
[4] Nah, S., Kim, T.H. and Lee, K.M. (2017) Deep Multi-Scale Convolutional Neural Network for Dynamic Scene Deblurring. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 257-265. [Google Scholar] [CrossRef
[5] He, K., Sun, J. and Tang, X. (2011) Single Image Haze Removal Using Dark Channel Prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 2341-2353. [Google Scholar] [CrossRef] [PubMed]
[6] Dong, C., Loy, C.C., He, K. and Tang, X. (2016) Image Super-Resolution Using Deep Convolutional Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 295-307. [Google Scholar] [CrossRef] [PubMed]
[7] Zhang, K., Zuo, W. and Zhang, L. (2018) FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising. IEEE Transactions on Image Processing, 27, 4608-4622. [Google Scholar] [CrossRef] [PubMed]
[8] Wang, Y., Yao, Q., Kwok, J.T. and Ni, L.M. (2020) Generalizing from a Few Examples. ACM Computing Surveys, 53, 1-34. [Google Scholar] [CrossRef
[9] Zontak, M. and Irani, M. (2011) Internal Statistics of a Single Natural Image. IEEE Conference on Computer Vision and Pattern Recognition 2011, Colorado, 20-25 June 2011, 977-984. [Google Scholar] [CrossRef
[10] Hospedales, T.M., Antoniou, A., Micaelli, P. and Storkey, A.J. (2021) Meta-Learning in Neural Networks: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 5149-5169. [Google Scholar] [CrossRef] [PubMed]
[11] Goodfellow, I., Pouget-Abadie, J., Mirza, M., et al. (2014) Generative Adversarial Nets. Advances in Neural Information Processing Systems (NeurIPS), Montreal, 8-13 December 2014, 2672-2680.
[12] Jing, L. and Tian, Y. (2021) Self-Supervised Visual Feature Learning with Deep Neural Networks: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43, 4037-4058. [Google Scholar] [CrossRef] [PubMed]
[13] Le-Khac, P.H., Healy, G. and Smeaton, A.F. (2020) Contrastive Representation Learning: A Framework and Review. IEEE Access, 8, 193907-193934. [Google Scholar] [CrossRef
[14] Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., et al. (2021) A Comprehensive Survey on Transfer Learning. Proceedings of the IEEE, 109, 43-76. [Google Scholar] [CrossRef
[15] Finn C, Abbeel P, Levine S. (2017) Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. International Conference on Machine Learning (ICML), Sydney, 6-11 August 2017, 1126-1135.
[16] Hu, X., Mu, H., Zhang, X., Wang, Z., Tan, T. and Sun, J. (2019) Meta-SR: A Magnification-Arbitrary Network for Super-Resolution. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 1575-1584. [Google Scholar] [CrossRef
[17] Soh, J.W., Cho, S. and Cho, N.I. (2020) Meta-Transfer Learning for Zero-Shot Super-Resolution. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 13-19 June 2020, 3513-3522. [Google Scholar] [CrossRef
[18] Gao, X., Wang, Y., Cheng, J., Xu, M. and Wang, M. (2021) Meta-Learning Based Relation and Representation Learning Networks for Single-Image Deraining. Pattern Recognition, 120, Article 108124. [Google Scholar] [CrossRef
[19] Kim, Y., Cho, Y., Nguyen, T., Hong, S. and Lee, D. (2024) MetaWeather: Few-Shot Weather-Degraded Image Restoration. In: Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T. and Varol, G., Eds., Lecture Notes in Computer Science, Springer, 206-222. [Google Scholar] [CrossRef
[20] Tao, S., Li, W., Zhang, P., et al. (2024) MT-Net: Meta-Learning with Contrastive Learning for Few-Shot Single Image Dehazing. Journal of Visual Communication and Image Representation, 105, 104325.
[21] Shaham, T.R., Dekel, T. and Michaeli, T. (2019) Singan: Learning a Generative Model from a Single Natural Image. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, 27 October 2019-2 November 2019, 4569-4579. [Google Scholar] [CrossRef
[22] Bell-Kligler, S., Shocher, A. and Irani, M. (2019) Blind Super-Resolution Kernel Estimation Using an Internal-GAN. Advances in Neural Information Processing Systems (NeurIPS), Vancouver, 8-14 December 2019, 284-293.
[23] Ulyanov, D., Vedaldi, A. and Lempitsky, V. (2018) Deep Image Prior. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, 18-22 June 2018, 9446-9454.
[24] Shocher, A., Cohen, N. and Irani, M. (2018) Zero-Shot Super-Resolution Using Deep Internal Learning. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 3118-3126. [Google Scholar] [CrossRef
[25] Lu, W., Jiang, X., Jin, X., Yang, Y.-L., Gong, M., Wang, T., Shi, K. and Zhao, H. (2023) GRIG: Few-Shot Generative Residual Image Inpainting. CoRR, abs/2304.12035.
[26] Suvorov, R., Logacheva, E., Mashikhin, A., Remizova, A., Ashukha, A., Silvestrov, A., et al. (2022) Resolution-Robust Large Mask Inpainting with Fourier Convolutions. 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, 3-8 January 2022, 3172-3182. [Google Scholar] [CrossRef
[27] Adrai, A., Lavy, S. and Michaeli, T. (2023) Deep Optimal Transport for Image Restoration. Advances in Neural Information Processing Systems (NeurIPS), 11-17 October 2021.
[28] Li, B., Liu, X., Hu, P., Wu, Z., Lv, J. and Peng, X. (2022) All-in-One Image Restoration for Unknown Corruption. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, 18-24 June 2022, 17431-17441. [Google Scholar] [CrossRef
[29] Doersch, C., Gupta, A. and Efros, A.A. (2015) Unsupervised Visual Representation Learning by Context Prediction. 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 7-13 December 2015, 1422-1430. [Google Scholar] [CrossRef
[30] van den Oord, A., Li, Y. and Vinyals, O. (2018) Representation Learning with Contrastive Predictive Coding. arXiv:1807.03748
[31] Lehtinen, J., Munkberg, J., Hasselgren, J., et al. (2018) Noise2Noise: Learning Image Restoration without Clean Data. International Conference on Machine Learning (ICML), Stockholm, 10-15 July 2018, 2965-2974.
[32] Krull, A., Buchholz, T. and Jug, F. (2019) Noise2Void: Learning Denoising from Single Noisy Images. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 2124-2132. [Google Scholar] [CrossRef
[33] Batson, J. and Royer, L. (2019) Noise2Self: Blind Denoising by Self-Supervision. International Conference on Machine Learning (ICML), Long Beach, California, 9-15 June 2019, 524-533.
[34] Quan, Y., Chen, M., Pang, T. and Ji, H. (2020) Self2self with Dropout: Learning Self-Supervised Denoising from Single Image. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 13-19 June 2020, 1887-1895. [Google Scholar] [CrossRef
[35] Huang, T., Li, S., Jia, X., Lu, H. and Liu, J. (2021) Neighbor2neighbor: Self-Supervised Denoising from Single Noisy Images. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 14776-14785. [Google Scholar] [CrossRef
[36] Rai, S.N., Saluja, R., Arora, C., Balasubramanian, V.N., Subramanian, A. and Jawahar, C.V. (2022) FLUID: Few-Shot Self-Supervised Image Deraining. 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, 3-8 January 2022, 418-427. [Google Scholar] [CrossRef
[37] Moran, N., Schmidt, D., Zhong, Y. and Coady, P. (2020) Noisier2Noise: Learning to Denoise from Unpaired Noisy Data. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 13-19 June 2020, 12061-12069. [Google Scholar] [CrossRef
[38] Moran, N., Schmidt, D., Zhong, Y. and Coady, P. (2020) Noisier2Noise: Learning to Denoise from Unpaired Noisy Data. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, 13-19 June 2020, 12064-12072. [Google Scholar] [CrossRef
[39] Chen, T., Kornblith, S., Norouzi, M. and Hinton, G. (2020) A Simple Framework for Contrastive Learning of Visual Representations. International Conference on Machine Learning (ICML), 13-18 July 2020, 1597-1607.
[40] Zheng, Y., Zhan, J., He, S., Dong, J. and Du, Y. (2023) Curricular Contrastive Regularization for Physics-Aware Single Image Dehazing. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 5785-5794. [Google Scholar] [CrossRef
[41] Varghese, N. and Ambasamudram, R.N. (2023) Re-Degradation and Contrastive Learning for Zero-Shot Underwater Image Restoration. British Machine Vision Conference (BMVC), Aberdeen, 20-24 November 2023, 544-561.
[42] Wei, Y., Gu, S., Li, Y., Timofte, R., Jin, L. and Song, H. (2021) Unsupervised Real-World Image Super Resolution via Domain-Distance Aware Training. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 20-25 June 2021, 13380-13389. [Google Scholar] [CrossRef
[43] Wang, W., Zhang, H., Yuan, Z. and Wang, C. (2021) Unsupervised Real-World Super-Resolution: A Domain Adaptation Perspective. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 4318-4327. [Google Scholar] [CrossRef
[44] Guo, H., Li, J., Dai, T., Ouyang, Z., Ren, X. and Xia, S.-T. (2024) Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts. Advances in Neural Information Processing Systems (NeurIPS), Vancouver, 10-15 December 2024 13522-13547.
[45] Li, X., Jin, X., Fu, J., Yu, X., Tong, B. and Chen, Z. (2021) Few-Shot Real Image Restoration via Distortion-Relation Guided Transfer Learning. arXiv:2111.13078.
[46] Valanarasu, J.M.J., Oza, P., Hacihaliloglu, I. and Patel, V.M. (2022) TransWeather: Transformer-Based Restoration of Images Degraded by Adverse Weather Conditions. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, Louisiana, 19-24 June 2022, 2354-2363.
[47] Ye, Y., et al. (2023) Test-Time Degradation Adaption for Open-Set Image Restoration. arXiv:2312.02197.
[48] Gao, J., Zhang, J., Liu, X., Darrell, T., Shelhamer, E. and Wang, D. (2023) Back to the Source: Diffusion-Driven Adaptation to Test-Time Corruption. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 11786-11796. [Google Scholar] [CrossRef
[49] Ruiz, N., Li, Y., Jampani, V., Pritch, Y., Rubinstein, M. and Aberman, K. (2023) Dreambooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 22500-22510. [Google Scholar] [CrossRef
[50] Hu, E.J., Shen, Y., Wallis, P., et al. (2021) LoRA: Low-Rank Adaptation of Large Language Models. arXiv:2106.09685