CFNet: Context fusion network for multi-focus images

被引:5
作者
Zhang, Kang [1 ]
Wu, Zhiliang [1 ]
Yuan, Xia [1 ]
Zhao, Chunxia [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
关键词
TRANSFORM; PERFORMANCE; FRAMEWORK;
D O I
10.1049/ipr2.12363
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-focus image fusion aims to generate a clear image by fusing multiple source images. Existing deep learning-based fusion methods often neglect the context information resulting in the loss of detail information. To address this issue, a context fusion network to merge multi-focus images, namely CFNet, is proposed. Specifically, a context fusion module is proposed to make full use of low-level pixels and high-level semantic features. Particularly, the pyramid fusion mechanism and cross-scale transfer strategy are adopted to ensure the visual and semantic consistency of the fused image. Meanwhile, to extract salient features more effectively, a spatial attention mechanism is introduced to enhance these features. Further, the pyramid loss is used to progressively refine the fused features at each scale. Experimental results show that the proposed method is superior to some existing methods in both qualitative and quantitative evaluation.
引用
收藏
页码:499 / 508
页数:10
相关论文
共 48 条
  • [1] Multi-Focus Image Fusion Based on Spatial Frequency in Discrete Cosine Transform Domain
    Cao, Liu
    Jin, Longxu
    Tao, Hongjiang
    Li, Guoning
    Zhuang, Zhuang
    Zhang, Yanfu
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (02) : 220 - 224
  • [2] Pre-Trained Image Processing Transformer
    Chen, Hanting
    Wang, Yunhe
    Guo, Tianyu
    Xu, Chang
    Deng, Yiping
    Liu, Zhenhua
    Ma, Siwei
    Xu, Chunjing
    Xu, Chao
    Gao, Wen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12294 - 12305
  • [3] Multi-Focus Image Fusion With Point Detection Filter and Superpixel-Based Consistency Verification
    Chen, Qiang
    Yang, Bin
    Li, Yuehua
    Pang, Lihui
    [J]. IEEE ACCESS, 2020, 8 : 99956 - 99973
  • [4] Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition
    Cui, Guangmang
    Feng, Huajun
    Xu, Zhihai
    Li, Qi
    Chen, Yueting
    [J]. OPTICS COMMUNICATIONS, 2015, 341 : 199 - 209
  • [5] Multi-focus image fusion using deep support value convolutional neural network
    Du, ChaoBen
    Gao, SheSheng
    Liu, Ying
    Gao, BingBing
    [J]. OPTIK, 2019, 176 : 567 - 578
  • [6] Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network
    Du, Chaoben
    Gao, Shesheng
    [J]. IEEE ACCESS, 2017, 5 : 15750 - 15761
  • [7] FuseGAN: Learning to Fuse Multi-Focus Image via Conditional Generative Adversarial Network
    Guo, Xiaopeng
    Nie, Rencan
    Cao, Jinde
    Zhou, Dongming
    Mei, Liye
    He, Kangjian
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (08) : 1982 - 1996
  • [8] Fully Convolutional Network-Based Multifocus Image Fusion
    Guo, Xiaopeng
    Nie, Rencan
    Cao, Jinde
    Zhou, Dongming
    Qian, Wenhua
    [J]. NEURAL COMPUTATION, 2018, 30 (07) : 1775 - 1800
  • [9] Multifocus Color Image Fusion Based on NSST and PCNN
    Jin, Xin
    Nie, Rencan
    Zhou, Dongming
    Wang, Quan
    He, Kangjian
    [J]. JOURNAL OF SENSORS, 2016, 2016
  • [10] Perceptual Losses for Real-Time Style Transfer and Super-Resolution
    Johnson, Justin
    Alahi, Alexandre
    Li Fei-Fei
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 694 - 711