HDR Image Reconstruction Using Segmented Image Learning

被引:6
作者
Lee, Byeong Dae [1 ]
Sunwoo, Myung Hoon [1 ]
机构
[1] Ajou Univ, Sch Elect Engn, Suwon 16499, South Korea
基金
新加坡国家研究基金会;
关键词
Image restoration; Dynamic range; Deep learning; Image segmentation; Image reconstruction; Brightness; Cameras; High dynamic range imaging; inverse tone mapping; deep learning; single exposure image; DYNAMIC-RANGE EXPANSION;
D O I
10.1109/ACCESS.2021.3119586
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Converting a low dynamic range (LDR) image into a high dynamic range (HDR) image produces an image that closely depicts the real world without requiring expensive devices. Recent deep learning developments can produce highly realistic and sophisticated HDR images. This paper proposes a deep learning method to segment the bright and dark regions from an input LDR image and reconstruct the corresponding HDR image with similar dynamic ranges in the real world. The proposed multi-stage deep learning network brightens bright regions and darkens dark regions, and features with extended brightness range are combined to form the HDR image. Dividing the LDR image into the bright and dark regions effectively implements information on lost over-exposed and under-exposed areas, reconstructing a natural HDR image with color and appearance that is similar to reality. Experimental results confirm that the proposed method achieves an 8.52% higher HDR visual difference predictor (HDR-VDP) and a 41.2% higher log exposure range than current methods. Qualitative evaluation also verifies that the proposed method generates images that are close in quality to the ground truth.
引用
收藏
页码:142729 / 142742
页数:14
相关论文
共 49 条
[21]  
King DB, 2015, ACS SYM SER, V1214, P1
[22]  
Lee S., IEEE T MULTIMEDIA, V23, P2021
[23]   Deep Recursive HDRI: Inverse Tone Mapping Using Generative Adversarial Networks [J].
Lee, Siyeong ;
An, Gwon Hwan ;
Kang, Suk-Ju .
COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 :613-628
[24]   Deep Chain HDRI: Reconstructing a High Dynamic Range Image from a Single Low Dynamic Range Image [J].
Lee, Siyeong ;
An, Gwon Hwan ;
Kang, Suk-Ju .
IEEE ACCESS, 2018, 6 :49913-49924
[25]   Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline [J].
Liu, Yu-Lun ;
Lai, Wei-Sheng ;
Chen, Yu-Sheng ;
Kao, Yi-Lung ;
Yang, Ming-Hsuan ;
Chuang, Yung-Yu ;
Huang, Jia-Bin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1648-1657
[26]   Deep Guided Learning for Fast Multi-Exposure Image Fusion [J].
Ma, Kede ;
Duanm, Zhengfang ;
Zhu, Hanwei ;
Fang, Yuming ;
Wang, Zhou .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) :2808-2819
[27]  
Maas A. L, 2013, INT C MACH LEARN ICM, V30
[28]  
Mantiuk R.K., 1999, Wiley Encyclopedia of Electrical and Electronics Engineering, P1
[29]   Display adaptive tone mapping [J].
Mantiuk, Rafal ;
Daly, Scott ;
Kerofsky, Louis .
ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03)
[30]   ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content [J].
Marnerides, D. ;
Bashford-Rogers, T. ;
Hatchett, J. ;
Debattista, K. .
COMPUTER GRAPHICS FORUM, 2018, 37 (02) :37-49