Superpixel-Based Quality Assessment of Multi-Exposure Image Fusion for Both Static and Dynamic Scenes

被引:21
作者
Fang, Yuming [1 ]
Zeng, Yan [1 ]
Jiang, Wenhui [1 ]
Zhu, Hanwei [2 ]
Yan, Jiebin [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330032, Jiangxi, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Heuristic algorithms; Computational modeling; Image fusion; Visualization; Quality assessment; Laplace equations; Databases; Multi-exposure image fusion; image quality assessment; superpixel; information theory;
D O I
10.1109/TIP.2021.3053465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-exposure image fusion (MEF) algorithms have been used to merge a stack of low dynamic range images with various exposure levels into a well-perceived image. However, little work has been dedicated to predicting the visual quality of fused images. In this work, we propose a novel and efficient objective image quality assessment (IQA) model for MEF images of both static and dynamic scenes based on superpixels and an information theory adaptive pooling strategy. First, with the help of superpixels, we divide fused images into large- and small-changed regions using the structural inconsistency map between each exposure and fused images. Then, we compute the quality maps based on the Laplacian pyramid for large- and small-changed regions separately. Finally, an information theory induced adaptive pooling strategy is proposed to compute the perceptual quality of the fused image. Experimental results on three public databases of MEF images demonstrate the proposed model achieves promising performance and yields a relatively low computational complexity. Additionally, we also demonstrate the potential application for parameter tuning of MEF algorithms.
引用
收藏
页码:2526 / 2537
页数:12
相关论文
共 60 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
Burt P. J., 1993, [1993] Proceedings Fourth International Conference on Computer Vision, P173, DOI 10.1109/ICCV.1993.378222
[3]  
Burt P.J., 1984, Multiresolution Image Processing and Analysis
[4]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[5]   A human perception inspired quality metric for image fusion based on regional information [J].
Chen, Hao ;
Varshney, Pramod K. .
INFORMATION FUSION, 2007, 8 (02) :193-207
[6]   A new automated quality assessment algorithm for image fusion [J].
Chen, Yin ;
Blum, Rick S. .
IMAGE AND VISION COMPUTING, 2009, 27 (10) :1421-1432
[7]   Image fusion metric based on mutual information and Tsallis entropy [J].
Cvejic, N. ;
Canagarajah, C. N. ;
Bull, D. R. .
ELECTRONICS LETTERS, 2006, 42 (11) :626-627
[8]   Perceptual Evaluation for Multi-Exposure Image Fusion of Dynamic Scenes [J].
Fang, Yuming ;
Zhu, Hanwei ;
Ma, Kede ;
Wang, Zhou ;
Li, Shutao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :1127-1138
[9]  
Fang YM, 2017, IEEE IMAGE PROC, P3165, DOI 10.1109/ICIP.2017.8296866
[10]  
Gallo O., 2009, 2009 IEEE INT C COMP, P1