CFNet: Context fusion network for multi-focus images

被引:5
作者
Zhang, Kang [1 ]
Wu, Zhiliang [1 ]
Yuan, Xia [1 ]
Zhao, Chunxia [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
关键词
TRANSFORM; PERFORMANCE; FRAMEWORK;
D O I
10.1049/ipr2.12363
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-focus image fusion aims to generate a clear image by fusing multiple source images. Existing deep learning-based fusion methods often neglect the context information resulting in the loss of detail information. To address this issue, a context fusion network to merge multi-focus images, namely CFNet, is proposed. Specifically, a context fusion module is proposed to make full use of low-level pixels and high-level semantic features. Particularly, the pyramid fusion mechanism and cross-scale transfer strategy are adopted to ensure the visual and semantic consistency of the fused image. Meanwhile, to extract salient features more effectively, a spatial attention mechanism is introduced to enhance these features. Further, the pyramid loss is used to progressively refine the fused features at each scale. Experimental results show that the proposed method is superior to some existing methods in both qualitative and quantitative evaluation.
引用
收藏
页码:499 / 508
页数:10
相关论文
共 48 条
[11]   Multi-focus image fusion algorithm based on supervised learning for fully convolutional neural network [J].
Li, Heng ;
Zhang, Liming ;
Jiang, Meirong ;
Li, Yulong .
PATTERN RECOGNITION LETTERS, 2021, 141 (141) :45-53
[12]   Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection [J].
Li, Huafeng ;
Chai, Yi ;
Li, Zhaofei .
OPTIK, 2013, 124 (01) :40-51
[13]   DenseFuse: A Fusion Approach to Infrared and Visible Images [J].
Li, Hui ;
Wu, Xiao-Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2614-2623
[14]   DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion [J].
Li, Jinxing ;
Guo, Xiaobao ;
Lu, Guangming ;
Zhang, Bob ;
Xu, Yong ;
Wu, Feng ;
Zhang, David .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4816-4831
[15]   Image Fusion with Guided Filtering [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) :2864-2875
[16]   Image matting for fusion of multi-focus images in dynamic scenes [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen ;
Yang, Bin .
INFORMATION FUSION, 2013, 14 (02) :147-162
[17]   Multifocus image fusion scheme based on the multiscale curvature in nonsubsampled contourlet transform domain [J].
Li, Xiaosong ;
Li, Huafeng ;
Yu, Zhengtao ;
Kong, Yingchun .
OPTICAL ENGINEERING, 2015, 54 (07)
[18]  
Li XL, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P2208
[19]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[20]   Image Inpainting for Irregular Holes Using Partial Convolutions [J].
Liu, Guilin ;
Reda, Fitsum A. ;
Shih, Kevin J. ;
Wang, Ting-Chun ;
Tao, Andrew ;
Catanzaro, Bryan .
COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 :89-105