Superpixel-Based Quality Assessment of Multi-Exposure Image Fusion for Both Static and Dynamic Scenes

被引:21
作者
Fang, Yuming [1 ]
Zeng, Yan [1 ]
Jiang, Wenhui [1 ]
Zhu, Hanwei [2 ]
Yan, Jiebin [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330032, Jiangxi, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Heuristic algorithms; Computational modeling; Image fusion; Visualization; Quality assessment; Laplace equations; Databases; Multi-exposure image fusion; image quality assessment; superpixel; information theory;
D O I
10.1109/TIP.2021.3053465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-exposure image fusion (MEF) algorithms have been used to merge a stack of low dynamic range images with various exposure levels into a well-perceived image. However, little work has been dedicated to predicting the visual quality of fused images. In this work, we propose a novel and efficient objective image quality assessment (IQA) model for MEF images of both static and dynamic scenes based on superpixels and an information theory adaptive pooling strategy. First, with the help of superpixels, we divide fused images into large- and small-changed regions using the structural inconsistency map between each exposure and fused images. Then, we compute the quality maps based on the Laplacian pyramid for large- and small-changed regions separately. Finally, an information theory induced adaptive pooling strategy is proposed to compute the perceptual quality of the fused image. Experimental results on three public databases of MEF images demonstrate the proposed model achieves promising performance and yields a relatively low computational complexity. Additionally, we also demonstrate the potential application for parameter tuning of MEF algorithms.
引用
收藏
页码:2526 / 2537
页数:12
相关论文
共 60 条
[41]   Evaluating Multiexposure Fusion Using Image Information [J].
Rahman, Hisham ;
Soundararajan, Rajiv ;
Babu, R. Venkatesh .
IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (11) :1671-1675
[42]  
Reinhard E, 2002, ACM T GRAPHIC, V21, P267, DOI 10.1145/566570.566575
[43]   Robust Patch-Based HDR Reconstruction of Dynamic Scenes [J].
Sen, Pradeep ;
Kalantari, Nima Khademi ;
Yaesoubi, Maziar ;
Darabi, Soheil ;
Goldman, Dan B. ;
Shechtman, Eli .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (06)
[44]   A statistical evaluation of recent full reference image quality assessment algorithms [J].
Sheikh, Hamid Rahim ;
Sabir, Muhammad Farooq ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (11) :3440-3451
[45]   Image information and visual quality [J].
Sheikh, HR ;
Bovik, AC .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (02) :430-444
[46]   Exposure Fusion Using Boosting Laplacian Pyramid [J].
Shen, Jianbing ;
Zhao, Ying ;
Yan, Shuicheng ;
Li, Xuelong .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (09) :1579-1590
[47]  
Shreya Prabhu K., 2020, P IEEE 17 IND COUNC, P1, DOI [10.1109/INDICON49873.2020.9342332, DOI 10.1109/INDICON49873.2020.9342332]
[48]   SPSIM: A Superpixel-Based Similarity Index for Full-Reference Image Quality Assessment [J].
Sun, Wen ;
Liao, Qingmin ;
Xue, Jing-Hao ;
Zhou, Fei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (09) :4232-4244
[49]   Bilateral filtering for gray and color images [J].
Tomasi, C ;
Manduchi, R .
SIXTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, 1998, :839-846
[50]   The State of the Art in HDR Deghosting: A Survey and Evaluation [J].
Tursun, Okan Tarhan ;
Akyuz, Ahmet Oguz ;
Erdem, Aykut ;
Erdem, Erkut .
COMPUTER GRAPHICS FORUM, 2015, 34 (02) :683-707