A lightweight scheme for multi-focus image fusion

被引:14
作者
Jin, Xin [1 ]
Hou, Jingyu [2 ]
Nie, Rencan [1 ]
Yao, Shaowen [3 ]
Zhou, Dongming [1 ]
Jiang, Qian [1 ]
He, Kangjian [1 ]
机构
[1] Yunnan Univ, Sch Informat, Kunming, Yunnan, Peoples R China
[2] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia
[3] Yunnan Univ, Sch Software, Kunming, Yunnan, Peoples R China
基金
中国国家自然科学基金;
关键词
Image processing; Image fusion; Pulse coupled neural networks; Laplacian pyramid transform; Spatial frequency; MANY-CORE PROCESSORS; WAVELET TRANSFORM; PYRAMID DECOMPOSITION; CONTOURLET TRANSFORM; PARALLEL FRAMEWORK; NEURAL-NETWORK; PCNN; LINKING; DOMAIN;
D O I
10.1007/s11042-018-5659-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The aim of multi-focus image fusion is to fuse the images taken from the same scene with different focuses so that we can obtain a resultant image with all objects in focus. However, the most existing techniques in many cases cannot gain good fusion performance and acceptable complexity simultaneously. In order to improve image fusion efficiency and performance, we propose a lightweight multi-focus image fusion scheme based on Laplacian pyramid transform (LPT) and adaptive pulse coupled neural networks-local spatial frequency (PCNN-LSF), and it only needs to deal with fewer sub-images than common methods. The proposed scheme employs LPT to decompose a source image into the corresponding constituent sub-images. Spatial frequency (SF) is calculated to adjust the linking strength, beta of PCNN according to the gradient features of the sub-images. Then oscillation frequency graph (OFG) of the sub-images is generated by PCNN model. Local spatial frequency (LSF) of the OFG is calculated as the key step to fuse the sub-images. Incorporating LSF of the OFG into the fusion scheme (LSF of the OFG represents the information of its regional features); it can effectively describe the detailed information of the sub-images. LSF can enhance the features of OFG and makes it easy to extract high quality coefficient of the sub-image. The experiments indicate that the proposed scheme achieves good fusion effect and is more efficient than other commonly used image fusion algorithms.
引用
收藏
页码:23501 / 23527
页数:27
相关论文
共 37 条
  • [1] Image fusion based on nonsubsampled contourlet transform for infrared and visible light image
    Adu, Jianhua
    Gan, Jianhong
    Wang, Yan
    Huang, Jian
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2013, 61 : 94 - 100
  • [2] Two-scale image fusion of visible and infrared images using saliency detection
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2016, 76 : 52 - 64
  • [3] Multimodal Medical Image Sensor Fusion Framework Using Cascade of Wavelet and Contourlet Transform Domains
    Bhateja, Vikrant
    Patel, Himanshi
    Krishn, Abhinav
    Sahu, Akanksha
    Lay-Ekuakille, Aime
    [J]. IEEE SENSORS JOURNAL, 2015, 15 (12) : 6783 - 6790
  • [4] Image fusion of visible and thermal images for fruit detection
    Bulanon, D. M.
    Burks, T. F.
    Alchanatis, V.
    [J]. BIOSYSTEMS ENGINEERING, 2009, 103 (01) : 12 - 22
  • [5] Remote sensing image fusion via wavelet transform and sparse representation
    Cheng, Jian
    Liu, Haijun
    Liu, Ting
    Wang, Feng
    Li, Hongsheng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2015, 104 : 158 - 173
  • [6] Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex
    Eckhorn, R.
    Reitboeck, H. J.
    Arndt, M.
    Dicke, P.
    [J]. NEURAL COMPUTATION, 1990, 2 (03) : 293 - 307
  • [7] Eckhorn R., 1989, MODELS BRAIN FUNCTIO, P255, DOI DOI 10.1139/W00-039
  • [8] Image quality measures and their performance
    Eskicioglu, AM
    Fisher, PS
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) : 2959 - 2965
  • [9] Frejlichowski D, 2010, LECT NOTES COMPUT SC, V6112, P151, DOI 10.1007/978-3-642-13775-4_16
  • [10] Multi-modal Image Fusion Based on ROI and Laplacian Pyramid
    Gao, Xiong
    Zhang, Hong
    Chen, Hao
    Li, Jiafeng
    [J]. SIXTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2014), 2015, 9443