HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantization

被引:74
作者
Chen, Xiangyu [1 ]
Liu, Yihao [1 ,2 ]
Zhang, Zhengwen [1 ]
Qiao, Yu [1 ,3 ]
Dong, Chao [1 ,4 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Key Lab Human Machine Intelligence Synergy Syst, Shenzhen, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Shanghai AI Lab, Shanghai, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, SIAT Branch, Shenzhen, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021 | 2021年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPRW53098.2021.00045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most consumer-grade digital cameras can only capture a limited range of luminance in real-world scenes due to sensor constraints. Besides, noise and quantization errors are often introduced in the imaging process. In order to obtain high dynamic range (HDR) images with excellent visual quality, the most common solution is to combine multiple images with different exposures. However, it is not always feasible to obtain multiple images of the same scene and most HDR reconstruction methods ignore the noise and quantization loss. In this work, we propose a novel learning-based approach using a spatially dynamic encoder-decoder network, HDRUNet, to learn an end-to-end mapping for single image HDR reconstruction with denoising and dequantization. The network consists of a UNet-style base network to make full use of the hierarchical multi-scale information, a condition network to perform pattern-specific modulation and a weighting network for selectively retaining information. Moreover, we propose a Tanh_L-1 loss function to balance the impact of over-exposed values and well-exposed values on the network learning. Our method achieves the state-of-the-art performance in quantitative comparisons and visual quality. The proposed HDRUNet model won the second place in the single frame track of NITRE2021 High Dynamic Range Challenge.
引用
收藏
页码:354 / 363
页数:10
相关论文
共 55 条
[1]   Do HDR displays support LDR content?: a psychophysical evaluation [J].
Akyuez, Ahmet Oguz ;
Fleming, Roland ;
Riecke, Bernhard E. ;
Reinhard, Erik ;
Buethoff, Heinrich H. .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[2]  
[Anonymous], 2020, AAAI
[3]  
[Anonymous], 2015, Tiny ImageNet Visual Recognition Challenge., DOI DOI 10.1109/ICCV.2015.123
[4]  
Banterle F., 2017, ADV HIGH DYNAMIC RAN
[5]  
Banterle F., 2006, P 4 INT C COMP GRAPH, P349
[6]   A framework for inverse tone mapping [J].
Banterle, Francesco ;
Ledda, Patrick ;
Debattista, Kurt ;
Chalmers, Alan ;
Bloj, Marina .
VISUAL COMPUTER, 2007, 23 (07) :467-478
[7]   High Dynamic Range Imaging and Low Dynamic Range Expansion for Generating HDR Content [J].
Banterle, Francesco ;
Debattista, Kurt ;
Artusi, Alessandro ;
Pattanaik, Sumanta ;
Myszkowski, Karol ;
Ledda, Patrick ;
Chalmers, Alan .
COMPUTER GRAPHICS FORUM, 2009, 28 (08) :2343-2367
[8]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[9]   Decontouring: prevention and removal of false contour artifacts [J].
Daly, S ;
Feng, XF .
HUMAN VISION AND ELECTRONIC IMAGING IX, 2004, 5292 :130-149
[10]   Bit-depth extension using spatiotemporal microdither based on models of the equivalent input noise of the visual system [J].
Daly, S ;
Feng, XF .
COLOR IMAGING VIII: PROCESSING, HARDCOPY, AND APPLICATIONS, 2003, 5008 :455-466