金字塔域双边加权引导滤波的多聚焦图像融合算法研究
Research on Multi-Focus Image Fusion Algorithm Based on Bilateral Weighted Guided Filtering in Pyramid Domain
DOI: 10.12677/jisp.2025.142022, PDF,    科研立项经费支持
作者: 尹建国:淮阴师范学院计算机科学与技术学院,江苏 淮安;郭立强:淮阴师范学院计算机科学与技术学院,江苏 淮安;淮阴师范学院江苏省智慧物联大数据工程研究中心,江苏 淮安
关键词: 双边加权引导滤波图像金字塔图像融合Bilateral Weighted Guided Filter Image Pyramid Image Fusion
摘要: 为了克服传统多聚焦图像融合方法中的边缘失真和图像模糊问题,提出了一种金字塔域双边加权引导滤波的融合方法。首先,利用双边加权引导滤波对均值滤波和差分算子得到粗糙焦点图进行细化并作为金字塔融合过程中高频信息选择策略,在金字塔下采样过程中,采用双边加权引导滤波替代传统的高斯滤波,更有效地保留图像的边缘信息。同时,为了提升图像细节部分,以原始待融合图像的均值作为参考,进行差异运算,构建了两个图像金字塔,并对每个金字塔单独处理,之后利用高频信息决策图进行叠加,通过重建金字塔得到融合图像。实验结果表明,无论是在主观视觉感知还是在客观评价指标方面,本文所提出的方法在视觉保真度等多个指标上优于经典方法,具有较好的图像融合效果。
Abstract: In order to overcome the problems of edge distortion and image blur in the traditional multi-focus image fusion method, a fusion method based on Bilateral Weighted guided filtering in the pyramid domain was proposed. Firstly, the bilateral weighted guided filter is used to refine the rough focus map obtained by the mean filter and the difference operator, and as a high-frequency information selection strategy in the pyramid fusion process, the double-sided weighted guided filter is used to replace the traditional Gaussian filter in the pyramid downsampling process, so as to retain the edge information of the image more effectively. At the same time, in order to improve the detail of the image, the average value of two original images with a different focus was used as a reference, and two image pyramids were constructed by different operations, and each pyramid was processed separately, and then the high-frequency information decision map was used to superimpose and obtain the fusion image by reconstructing the pyramid. Experimental results show that the proposed method is superior to the classical method in terms of visual fidelity and other indicators, and has a better image fusion effect.
文章引用:尹建国, 郭立强. 金字塔域双边加权引导滤波的多聚焦图像融合算法研究[J]. 图像与信号处理, 2025, 14(2): 232-244. https://doi.org/10.12677/jisp.2025.142022

参考文献

[1] Zhang, H., Xu, H., Tian, X., Jiang, J. and Ma, J. (2021) Image Fusion Meets Deep Learning: A Survey and Perspective. Information Fusion, 76, 323-336. [Google Scholar] [CrossRef
[2] 苑津莎, 赵振兵, 高强, 孔英会. 红外与可见光图像配准研究现状与展望[J]. 激光与红外, 2009, 39(7): 693-699.
[3] Zhang, X. (2022) Deep Learning-Based Multi-Focus Image Fusion: A Survey and a Comparative Study. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 4819-4838.
[4] 唐霖峰, 张浩, 徐涵, 等. 基于深度学习的图像融合方法综述[J]. 中国图象图形学报, 2023, 28(1): 3-36.
[5] Ma, J., Ma, Y. and Li, C. (2019) Infrared and Visible Image Fusion Methods and Applications: A Survey. Information Fusion, 45, 153-178. [Google Scholar] [CrossRef
[6] 王蓉, 柴玉华, 高立群, 等. 图像融合技术及融合效果评价的研究[J]. 农机化研究, 2006(1): 87-89.
[7] Burt, P. and Adelson, E. (1983) The Laplacian Pyramid as a Compact Image Code. IEEE Transactions on Communications, 31, 532-540. [Google Scholar] [CrossRef
[8] Toet, A. (1989) Image Fusion by a Ratio of Low-Pass Pyramid. Pattern Recognition Letters, 9, 245-253. [Google Scholar] [CrossRef
[9] 张贵仓, 苏金凤, 拓明秀. DTCWT域的红外与可见光图像融合算法[J]. 计算机工程与科学, 2020, ,42(7): 8-17.
[10] Liu, Y., Chen, X., Peng, H. and Wang, Z. (2017) Multi-Focus Image Fusion with a Deep Convolutional Neural Network. Information Fusion, 36, 191-207. [Google Scholar] [CrossRef
[11] Shao, X., Jin, X., Jiang, Q., Miao, S., Wang, P. and Chu, X. (2024) Multi-Focus Image Fusion Based on Transformer and Depth Information Learning. Computers and Electrical Engineering, 119, Article ID: 109629. [Google Scholar] [CrossRef
[12] Ouyang, Y., Zhai, H., Hu, H., Li, X. and Zeng, Z. (2025) FusionGCN: Multi-Focus Image Fusion Using Superpixel Features Generation GCN and Pixel-Level Feature Reconstruction CNN. Expert Systems with Applications, 262, Article ID: 125665. [Google Scholar] [CrossRef
[13] Huang, J., Le, Z., Ma, Y., Mei, X. and Fan, F. (2020) A Generative Adversarial Network with Adaptive Constraints for Multi-Focus Image Fusion. Neural Computing and Applications, 32, 15119-15129. [Google Scholar] [CrossRef
[14] 费思成. 面向无线多媒体传感器网络低功耗图像融合算法研究[D]: [硕士学位论文]. 长沙: 湖南大学, 2016.
[15] 惠红军, 杨洋, 詹永照, 等. 双边加权引导图像滤波[J]. 江苏大学学报(自然科学版), 2024, 45(1): 60-66+76.
[16] 廖丽娜, 李伟彤, 项颖. 结合SML与差分图像的多聚焦图像融合算法[J]. 液晶与显示, 2023, 38(4): 524-533.
[17] Qiu, X., Li, M., Zhang, L. and Yuan, X. (2019) Guided Filter-Based Multi-Focus Image Fusion through Focus Region Detection. Signal Processing: Image Communication, 72, 35-46. [Google Scholar] [CrossRef
[18] Nejati, M. (2016) Lytro Multi-Focus Image Dataset.
[19] Yu, W., Nie, Y. and Xiong, W. (2024) An Adaptive Region Division Multi-Focus Image Fusion Algorithm with Defocus Diffusion Mitigation Mechanism. Proceedings of the 2024 2nd Asia Conference on Computer Vision, Image Processing and Pattern Recognition, Xiamen, 26-28 April 2024, 1-6. [Google Scholar] [CrossRef
[20] Bavirisetti, D.P., Xiao, G., Zhao, J., Dhuli, R. and Liu, G. (2019) Multi-Scale Guided Image and Video Fusion: A Fast and Efficient Approach. Circuits, Systems, and Signal Processing, 38, 5576-5605. [Google Scholar] [CrossRef
[21] Bavirisetti, D.P. and Dhuli, R. (2016) Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform. IEEE Sensors Journal, 16, 203-209. [Google Scholar] [CrossRef
[22] Naji, M.A. and Aghagolzadeh, A. (2015) Multi-Focus Image Fusion in DCT Domain Based on Correlation Coefficient. 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI), Tehran, 5-6 November 2015, 631-638. [Google Scholar] [CrossRef
[23] Li, X., Wang, X., Cheng, X., Tan, H. and Li, X. (2022) Multi-Focus Image Fusion Based on Hessian Matrix Decomposition and Salient Difference Focus Detection. Entropy, 24, Article No. 1527. [Google Scholar] [CrossRef] [PubMed]
[24] Cui, G., Feng, H., Xu, Z., Li, Q. and Chen, Y. (2015) Detail Preserved Fusion of Visible and Infrared Images Using Regional Saliency Extraction and Multi-Scale Image Decomposition. Optics Communications, 341, 199-209. [Google Scholar] [CrossRef
[25] Yuan, Y. (2011) Objective Quality Evaluation of Visible and Infrared Color Fusion Image. Optical Engineering, 50, Article ID: 033202. [Google Scholar] [CrossRef
[26] Huang, K., Wang, Q. and Wu, Z. (2006) Natural Color Image Enhancement and Evaluation Algorithm Based on Human Visual System. Computer Vision and Image Understanding, 103, 52-63. [Google Scholar] [CrossRef
[27] Rajalingam B., and Priya R., (2018) Enhancement of Hybrid Multimodal Medical Image Fusion Techniques for Clinical Disease Analysis. International Journal of Computer Vision and Image Processing, 8, 16-40. [Google Scholar] [CrossRef
[28] Mittal, A., Moorthy, A.K. and Bovik, A.C. (2012) No-Reference Image Quality Assessment in the Spatial Domain. IEEE Transactions on Image Processing, 21, 4695-4708. [Google Scholar] [CrossRef] [PubMed]
[29] Eskicioglu, A.M. and Fisher, P.S. (1995) Image Quality Measures and Their Performance. IEEE Transactions on Communications, 43, 2959-2965. [Google Scholar] [CrossRef
[30] Han, Y., Cai, Y., Cao, Y. and Xu, X. (2013) A New Image Fusion Performance Metric Based on Visual Information Fidelity. Information Fusion, 14, 127-135. [Google Scholar] [CrossRef