Low-Light Image Restoration With Short- and Long-Exposure Raw Pairs

被引:32
作者
Chang, Meng [1 ]
Feng, Huajun [1 ]
Xu, Zhihai [1 ]
Li, Qi [1 ]
机构
[1] Zhejiang Univ, State Key Lab Modern Opt Instrumentat, Hangzhou 310027, Peoples R China
关键词
Imaging; Image color analysis; Colored noise; Task analysis; Pipelines; Noise reduction; Mobile handsets; Deblurring; denoising; image fusion; image restoration; low-light imaging;
D O I
10.1109/TMM.2021.3058586
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Low-light imaging with handheld mobile devices is a challenging issue. Limited by the existing models and training data, most existing methods cannot be effectively applied in real scenarios. In this paper, we propose a new low-light image restoration method by using the complementary information of short- and long-exposure images. We first propose a novel data generation method to synthesize realistic short- and long-exposure raw images by simulating the imaging pipeline in low-light environment. Then, we design a new long-short-exposure fusion network (LSFNet) to deal with the problems of low-light image fusion, including high noise, motion blur, color distortion and misalignment. The proposed LSFNet takes pairs of short- and long-exposure raw images as input, and outputs a clear RGB image. Using our data generation method and the proposed LSFNet, we can recover the details and color of the original scene, and improve the low-light image quality effectively. Experiments demonstrate that our method can outperform the state-of-the-art methods.
引用
收藏
页码:702 / 714
页数:13
相关论文
共 56 条
[1]   Noise Flow: Noise Modeling with Conditional Normalizing Flows [J].
Abdelhamed, Abdelrahman ;
Brubaker, Marcus A. ;
Brown, Michael S. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3165-3173
[2]   A High-Quality Denoising Dataset for Smartphone Cameras [J].
Abdelhamed, Abdelrahman ;
Lin, Stephen ;
Brown, Michael S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1692-1700
[3]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[4]   Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks [J].
Aittala, Miika ;
Durand, Fredo .
COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 :748-764
[5]   Real Image Denoising with Feature Attention [J].
Anwar, Saeed ;
Barnes, Nick .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3155-3164
[6]   Unprocessing Images for Learned Raw Denoising [J].
Brooks, Tim ;
Mildenhall, Ben ;
Xue, Tianfan ;
Chen, Jiawen ;
Sharlet, Dillon ;
Barron, Jonathan T. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11028-11037
[7]  
Bychkovsky V, 2011, PROC CVPR IEEE, P97
[8]  
Chan K. C. K., 2020, ARXIVABS200907265
[9]   Learning to See in the Dark [J].
Chen, Chen ;
Chen, Qifeng ;
Xu, Jia ;
Koltun, Vladlen .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3291-3300
[10]  
Cho S, 2011, IEEE I CONF COMP VIS, P495, DOI 10.1109/ICCV.2011.6126280