Multi-Exposure Decomposition-Fusion Model for High Dynamic Range Image Saliency Detection

被引:16
作者
Wang, Xu [1 ,2 ]
Sun, Zhenhao [1 ,2 ]
Zhang, Qiudan [3 ]
Fang, Yuming [4 ]
Ma, Lin [5 ]
Wang, Shiqi [3 ]
Kwong, Sam [3 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen 518060, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330013, Jiangxi, Peoples R China
[5] Tencent AI Lab, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptation models; Saliency detection; Brightness; Predictive models; Feature extraction; Integrated circuit modeling; Dynamic range; High dynamic range; brightness adaptation; image saliency detection; deep learning; TONE REPRODUCTION; OPERATOR;
D O I
10.1109/TCSVT.2020.2985427
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High dynamic range (HDR) imaging techniques have witnessed a great improvement in the past few decades. However, saliency detection task on HDR content is still far from well explored. In this paper, we introduce a multi-exposure decomposition-fusion model for HDR image saliency detection inspired by the brightness adaption mechanism. The proposed model is composed of three modules. Firstly, a decomposition module converts the input raw HDR image into a stack of LDR images by uniformly sampling the exposure time range. Secondly, a saliency region proposal network is employed to generate the candidate saliency maps for each LDR image in the exposure stack. Finally, an uncertainty weighting based fusion algorithm is applied to generate the overall saliency map for the input HDR image by merging the obtained LDR saliency maps. Extensive experiments show that our proposed model achieves superior performance compared with the state-of-the-art methods on the existing HDR eye fixation databases. The source code of the proposed model are made publicly available at https://github.com/sunnycia/DFHSal.
引用
收藏
页码:4409 / 4420
页数:12
相关论文
共 39 条
[11]   Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model [J].
Cornia, Marcella ;
Baraldi, Lorenzo ;
Serra, Giuseppe ;
Cucchiara, Rita .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) :5142-5154
[12]  
Cornia M, 2016, INT C PATT RECOG, P3488, DOI 10.1109/ICPR.2016.7900174
[13]  
Debevec P.E., 2008, Recovering High Dynamic Range Radiance Maps from Photographs, P31
[14]   Human Visual System-Based Saliency Detection for High Dynamic Range Content [J].
Dong, Yuanyuan ;
Pourazad, Mahsa T. ;
Nasiopoulos, Panos .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (04) :549-562
[15]   Visual saliency estimation by nonlinearly integrating features using region covariances [J].
Erdem, Erkut ;
Erdem, Aykut .
JOURNAL OF VISION, 2013, 13 (04)
[16]   Video Saliency Incorporating Spatiotemporal Cues and Uncertainty Weighting [J].
Fang, Yuming ;
Wang, Zhou ;
Lin, Weisi ;
Fang, Zhijun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :3910-3921
[17]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[18]   Metering for Exposure Stacks [J].
Gallo, O. ;
Tico, M. ;
Manduchi, R. ;
Gelfand, N. ;
Pulli, K. .
COMPUTER GRAPHICS FORUM, 2012, 31 (02) :479-488
[19]  
Gonzalez R. C., 1977, READING MASS APPL MA, P451
[20]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778