High Dynamic Range and Super-Resolution Imaging From a Single Image

被引:20
作者
Park, Jae Sung [1 ,2 ]
Soh, Jae Woong [1 ]
Cho, Nam Ik [1 ]
机构
[1] Seoul Natl Univ, INMC, Dept Elect & Comp Engn, Seoul, South Korea
[2] Samsung Elect Co Ltd, Visual Display Div, Suwon, South Korea
关键词
Image enhancement; high dynamic range imaging; super resolution; convolutional neural network; ADAPTIVE HISTOGRAM EQUALIZATION; FUSION; ALGORITHM;
D O I
10.1109/ACCESS.2018.2797197
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents an algorithm for high dynamic range (HDR) and super-resolution (SR) imaging from a single image. First, we propose a new single image HDR imaging (HDRI) method based on the Retinex approach and exploit a recent single image SR method based on a convolutional neural network (CNN). Among many possible configurations of HDR and SR, we find an optimal system configuration and color manipulation strategy from the extensive experiments. Specifically, the best results are obtained when we first process the luminance component (Y) of input with our single image HDRI algorithm and then feed the enhanced HDR luminance to the CNN-based SR architecture that is trained by only luminance component. The ranges of chromatic components (U and V) are just scaled in proportion to the enhanced HDR luminance, and then they are bicubic interpolated or fed to the above CNN-based SR. Subjective and objective assessments for various experiments are presented to validate the effectiveness of the proposed HDR/SR imaging scheme.
引用
收藏
页码:10966 / 10978
页数:13
相关论文
共 41 条
[1]  
An J, 2011, INT CONF ACOUST SPEE, P1565
[2]  
[Anonymous], SMPTE MOTION IMAG J
[3]  
[Anonymous], GENERATION HIGH DYNA
[4]  
Banterle Francesco, 2017, ADV HIGH DYNAMIC RAN, P1
[5]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[6]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[7]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[8]  
Fairchild MD, 2007, FIFTEENTH COLOR IMAGING CONFERENCE: COLOR SCIENCE AND ENGINEERING SYSTEMS, TECHNOLOGIES, AND APPLICATIONS, FINAL PROGRAM AND PROCEEDINGS, P233
[9]   A fusion-based enhancing method for weakly illuminated images [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Liao, Yinghao ;
Ding, Xinghao ;
Paisley, John .
SIGNAL PROCESSING, 2016, 129 :82-96
[10]   No-Reference Image Sharpness Assessment in Autoregressive Parameter Space [J].
Gu, Ke ;
Zhai, Guangtao ;
Lin, Weisi ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (10) :3218-3231