An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields

被引:3
作者
Lin, Yu-Hsiu [1 ]
Hua, Kai-Lung [2 ]
Lu, Hsin-Han [3 ]
Sun, Wei-Lun [3 ]
Chen, Yung-Yao [3 ]
机构
[1] Ming Chi Univ Technol, Dept Elect Engn, New Taipei 243, Taiwan
[2] Natl Taiwan Univ Sci & Technol, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
[3] Natl Taipei Univ Technol, Grad Inst Automat Technol, Taipei 106, Taiwan
关键词
fuzzy logic; intelligent vision sensing; exposure fusion; coarse-to-fine tuning; detail manipulation; IMAGE FUSION; CONTRAST; OPERATOR; NOISE;
D O I
10.3390/s19214743
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
High dynamic range (HDR) has wide applications involving intelligent vision sensing which includes enhanced electronic imaging, smart surveillance, self-driving cars, intelligent medical diagnosis, etc. Exposure fusion is an essential HDR technique which fuses different exposures of the same scene into an HDR-like image. However, determining the appropriate fusion weights is difficult because each differently exposed image only contains a subset of the scene's details. When blending, the problem of local color inconsistency is more challenging; thus, it often requires manual tuning to avoid image artifacts. To address this problem, we present an adaptive coarse-to-fine searching approach to find the optimal fusion weights. In the coarse-tuning stage, fuzzy logic is used to efficiently decide the initial weights. In the fine-tuning stage, the multivariate normal conditional random field model is used to adjust the fuzzy-based initial weights which allows us to consider both intra- and inter-image information in the data. Moreover, a multiscale enhanced fusion scheme is proposed to blend input images when maintaining the details in each scale-level. The proposed fuzzy-based MNCRF (Multivariate Normal Conditional Random Fields) fusion method provided a smoother blending result and a more natural look. Meanwhile, the details in the highlighted and dark regions were preserved simultaneously. The experimental results demonstrated that our work outperformed the state-of-the-art methods not only in several objective quality measures but also in a user study analysis.
引用
收藏
页数:23
相关论文
共 41 条
[1]   Single-Scale Fusion: An Effective Approach to Merging Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (01) :65-78
[2]  
Ancuti C, 2016, IEEE IMAGE PROC, P4107, DOI 10.1109/ICIP.2016.7533132
[3]  
[Anonymous], P 2017 INT C COMP CO
[4]   Adaptive Curvature-Guided Image Filtering for Structure plus Texture Image Decomposition [J].
Belyaev, Alexander ;
Fayolle, Pierre-Alain .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) :5192-5203
[5]   Fuzzy Fusion Based High Dynamic Range Imaging using Adaptive Histogram Separation [J].
Celebi, Aysun Tasyapi ;
Duvar, Ramazan ;
Urhan, Oguzhan .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2015, 61 (01) :119-127
[6]   Multiple exposure fusion based on sharpness-controllable fuzzy feedback [J].
Chen, Yung-Yao ;
Hsia, Chih-Hsien ;
Lu, Chiao-Wen .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (02) :1121-1132
[7]   Anatomical-Functional Image Fusion by Information of Interest in Local Laplacian Filtering Domain [J].
Du, Jiao ;
Li, Weisheng ;
Xiao, Bin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (12) :5855-5866
[8]   Saliency Detection by Fully Learning a Continuous Conditional Random Field [J].
Fu, Keren ;
Gu, Irene Yu-Hua ;
Yang, Jie .
IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (07) :1531-1544
[9]   No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization [J].
Gu, Ke ;
Lin, Weisi ;
Zhai, Guangtao ;
Yang, Xiaokang ;
Zhang, Wenjun ;
Chen, Chang Wen .
IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (12) :4559-4565
[10]   Ghost-free multi exposure image fusion technique using dense SIFT descriptor and guided filter [J].
Hayat, Naila ;
Imran, Muhammad .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 62 :295-308