Multi-Exposure Decomposition-Fusion Model for High Dynamic Range Image Saliency Detection

被引:16
作者
Wang, Xu [1 ,2 ]
Sun, Zhenhao [1 ,2 ]
Zhang, Qiudan [3 ]
Fang, Yuming [4 ]
Ma, Lin [5 ]
Wang, Shiqi [3 ]
Kwong, Sam [3 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen 518060, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330013, Jiangxi, Peoples R China
[5] Tencent AI Lab, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptation models; Saliency detection; Brightness; Predictive models; Feature extraction; Integrated circuit modeling; Dynamic range; High dynamic range; brightness adaptation; image saliency detection; deep learning; TONE REPRODUCTION; OPERATOR;
D O I
10.1109/TCSVT.2020.2985427
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High dynamic range (HDR) imaging techniques have witnessed a great improvement in the past few decades. However, saliency detection task on HDR content is still far from well explored. In this paper, we introduce a multi-exposure decomposition-fusion model for HDR image saliency detection inspired by the brightness adaption mechanism. The proposed model is composed of three modules. Firstly, a decomposition module converts the input raw HDR image into a stack of LDR images by uniformly sampling the exposure time range. Secondly, a saliency region proposal network is employed to generate the candidate saliency maps for each LDR image in the exposure stack. Finally, an uncertainty weighting based fusion algorithm is applied to generate the overall saliency map for the input HDR image by merging the obtained LDR saliency maps. Extensive experiments show that our proposed model achieves superior performance compared with the state-of-the-art methods on the existing HDR eye fixation databases. The source code of the proposed model are made publicly available at https://github.com/sunnycia/DFHSal.
引用
收藏
页码:4409 / 4420
页数:12
相关论文
共 39 条
[1]  
[Anonymous], 2010, Proceedings of the European Conference on Computer Vision
[2]  
[Anonymous], 2015, PROC INT WORKSHOP VI
[3]  
[Anonymous], 2014, Comput. Sci.
[4]  
[Anonymous], 2006, Advances in neural information processing systems
[5]  
Banitalebi-Dehkordi A, 2015, EUR SIGNAL PR CONF, P1541, DOI 10.1109/EUSIPCO.2015.7362642
[6]  
Banterle F., 2017, Advanced High Dynamic Range Imaging
[7]  
Borji A., 2015, arXiv
[8]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[9]   Which tone-mapping operator is the best? A comparative study of perceptual quality [J].
Cerda-Company, Xim ;
Alejandro Parraga, C. ;
Otazu, Xavier .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2018, 35 (04) :626-638
[10]   Review of Visual Saliency Detection With Comprehensive Information [J].
Cong, Runmin ;
Lei, Jianjun ;
Fu, Huazhu ;
Cheng, Ming-Ming ;
Lin, Weisi ;
Huang, Qingming .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) :2941-2959