Multi-Scale Exposure Fusion Based on Multi-Visual Feature Measurement and Detail Enhancement Representation

被引:9
作者
Yang, Yong [1 ,2 ]
Zhang, Danjie [2 ]
Wan, Weiguo [3 ]
Huang, Shuying [4 ]
机构
[1] Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Jiangxi Univ Finance & Econ, Sch Software & Internet Things Engn, Nanchang 330032, Jiangxi, Peoples R China
[4] Tiangong Univ, Sch Software, Tianjin 300387, Peoples R China
基金
中国国家自然科学基金;
关键词
Laplace equations; Image color analysis; Image edge detection; Feature extraction; Image reconstruction; Image fusion; Weight measurement; Detail enhancement representation; image pyramid; multiexposure image fusion (MEF); visual feature measurement; IMAGE FUSION; QUALITY ASSESSMENT; DENSE SIFT; RATIO;
D O I
10.1109/TIM.2022.3176881
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multiexposure image fusion (MEF) is used to generate a high-quality image from a series of images with different exposure levels. The multiscale-based MEF method achieves better fusion performance than the single-scale-based method because it can better preserve the global contrast information. However, this method still has the problem of the loss of details in the fused results. To solve this problem, a novel multiscale exposure image fusion method based on multivisual feature measurement and detail enhancement representation in the intensity-hue-saturation (IHS) color space is proposed. First, three visual features of the source multiexposure images, namely contrast, saturation, and exposure, are measured and are then adopted to construct the initial weight maps with adaptive weighting coefficients. Second, to optimize the initial weight maps and obtain the middleweight maps, a decision map construction method is proposed by comparing the pixel values of the detail maps of the intensity components, which can enhance the representation of detail information. Third, guided filtering is applied to eliminate the noise in the middleweight maps to obtain the final weight maps, which improves the visual effect of the fused image. Finally, image pyramid decomposition and reconstruction are performed on the source images and the final weight maps to achieve the final fused image. Numerical experimental results indicate that the proposed method outperforms state-of-the-art methods in terms of subjective visual and quantitative evaluations.
引用
收藏
页数:14
相关论文
共 43 条
[1]   Single-Scale Fusion: An Effective Approach to Merging Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (01) :65-78
[2]  
[Anonymous], WAT IVC MULT EX
[3]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[4]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[5]   Image Fusion With No Gamut Problem by Improved Nonlinear IHS Transforms for Remote Sensing [J].
Chien, Chun-Liang ;
Tsai, Wen-Hsiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :651-663
[6]  
Draper N.R., 1966, Applied regression analysis
[7]  
Fairchild MD, 2007, FIFTEENTH COLOR IMAGING CONFERENCE: COLOR SCIENCE AND ENGINEERING SYSTEMS, TECHNOLOGIES, AND APPLICATIONS, FINAL PROGRAM AND PROCEEDINGS, P233
[8]   A new image fusion performance metric based on visual information fidelity [J].
Han, Yu ;
Cai, Yunze ;
Cao, Yin ;
Xu, Xiaoming .
INFORMATION FUSION, 2013, 14 (02) :127-135
[9]   Ghost-free multi exposure image fusion technique using dense SIFT descriptor and guided filter [J].
Hayat, Naila ;
Imran, Muhammad .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 62 :295-308
[10]   Guided Image Filtering [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (06) :1397-1409