Pixel-level image fusion: A survey of the state of the art

被引:934
作者
Li, Shutao [1 ]
Kang, Xudong [1 ]
Fang, Leyuan [1 ]
Hu, Jianwen [2 ]
Yin, Haitao [3 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha, Hunan, Peoples R China
[2] Changsha Univ Sci & Technol, Coll Elect & Informat Engn, Changsha, Hunan, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing, Jiangsu, Peoples R China
关键词
Image fusion; Multiscale decomposition; Sparse representation; Remote sensing; Medical imaging; QUALITY ASSESSMENT; MULTISCALE-DECOMPOSITION; INFORMATION MEASURE; MUTUAL INFORMATION; PERFORMANCE; TRANSFORM; WAVELET; RESOLUTION; FREQUENCY; ALGORITHM;
D O I
10.1016/j.inffus.2016.05.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pixel-level image fusion is designed to combine multiple input images into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. Due to this advantage, pixel-level image fusion has shown notable achievements in remote sensing, medical imaging, and night vision applications. In this paper, we first provide a comprehensive survey of the state of the art pixel-level image fusion methods. Then, the existing fusion quality measures are summarized. Next, four major applications, i.e., remote sensing, medical diagnosis, surveillance, photography, and challenges in pixel-level image fusion applications are analyzed. At last, this review concludes that although various image fusion methods have been proposed, there still exist several future directions in different image fusion applications. Therefore, the researches in the image fusion field are still expected to significantly grow in the coming years. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:100 / 112
页数:13
相关论文
共 139 条
[31]   Multimodal gray image fusion metric based on complex wavelet structural similarity [J].
Han, Yiyong .
OPTIK, 2015, 126 (24) :5842-5844
[32]   A new image fusion performance metric based on visual information fidelity [J].
Han, Yu ;
Cai, Yunze ;
Cao, Yin ;
Xu, Xiaoming .
INFORMATION FUSION, 2013, 14 (02) :127-135
[33]   Objective Quality Assessment for Multiexposure Multifocus Image Fusion [J].
Hassen, Rania ;
Wang, Zhou ;
Salama, Magdy M. A. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (09) :2712-2724
[34]   Fast natural color mapping for night-time imagery [J].
Hogervorst, Maarten A. ;
Toet, Alexander .
INFORMATION FUSION, 2010, 11 (02) :69-77
[35]   Comments on 'Information measure for performance of image fusion' [J].
Hossny, M. ;
Nahavandi, S. ;
Creighton, D. .
ELECTRONICS LETTERS, 2008, 44 (18) :1066-U28
[36]   Image fusion performance metric based on mutual information and entropy driven quadtree decomposition [J].
Hossny, M. ;
Nahavandi, S. ;
Creighton, D. ;
Bhatti, A. .
ELECTRONICS LETTERS, 2010, 46 (18) :1266-U45
[37]   The multiscale directional bilateral filter and its application to multisensor image fusion [J].
Hu, Jianwen ;
Li, Shutao .
INFORMATION FUSION, 2012, 13 (03) :196-206
[38]   HYPERSPECTRAL IMAGER SUITE (HISUI)-JAPANESE HYPER-MULTI SPECTRAL RADIOMETER [J].
Iwasaki, Akira ;
Ohgi, Nagamitsu ;
Tanii, Jun ;
Kawashima, Takahiro ;
Inada, Hitomi .
2011 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2011, :1025-1028
[39]   Medical image fusion: A survey of the state of the art [J].
James, Alex Pappachen ;
Dasarathy, Belur V. .
INFORMATION FUSION, 2014, 19 :4-19
[40]   Contrast-Enhanced Fusion of Multisensor Images Using Subband-Decomposed Multiscale Retinex [J].
Jang, Jae Ho ;
Bae, Yoonsung ;
Ra, Jong Beom .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (08) :3479-3490