Low-Light Image Restoration With Short- and Long-Exposure Raw Pairs

被引:28
作者
Chang, Meng [1 ]
Feng, Huajun [1 ]
Xu, Zhihai [1 ]
Li, Qi [1 ]
机构
[1] Zhejiang Univ, State Key Lab Modern Opt Instrumentat, Hangzhou 310027, Peoples R China
关键词
Imaging; Image color analysis; Colored noise; Task analysis; Pipelines; Noise reduction; Mobile handsets; Deblurring; denoising; image fusion; image restoration; low-light imaging;
D O I
10.1109/TMM.2021.3058586
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Low-light imaging with handheld mobile devices is a challenging issue. Limited by the existing models and training data, most existing methods cannot be effectively applied in real scenarios. In this paper, we propose a new low-light image restoration method by using the complementary information of short- and long-exposure images. We first propose a novel data generation method to synthesize realistic short- and long-exposure raw images by simulating the imaging pipeline in low-light environment. Then, we design a new long-short-exposure fusion network (LSFNet) to deal with the problems of low-light image fusion, including high noise, motion blur, color distortion and misalignment. The proposed LSFNet takes pairs of short- and long-exposure raw images as input, and outputs a clear RGB image. Using our data generation method and the proposed LSFNet, we can recover the details and color of the original scene, and improve the low-light image quality effectively. Experiments demonstrate that our method can outperform the state-of-the-art methods.
引用
收藏
页码:702 / 714
页数:13
相关论文
共 56 条
  • [1] Noise Flow: Noise Modeling with Conditional Normalizing Flows
    Abdelhamed, Abdelrahman
    Brubaker, Marcus A.
    Brown, Michael S.
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3165 - 3173
  • [2] A High-Quality Denoising Dataset for Smartphone Cameras
    Abdelhamed, Abdelrahman
    Lin, Stephen
    Brown, Michael S.
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1692 - 1700
  • [3] K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation
    Aharon, Michal
    Elad, Michael
    Bruckstein, Alfred
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) : 4311 - 4322
  • [4] Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks
    Aittala, Miika
    Durand, Fredo
    [J]. COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 748 - 764
  • [5] Real Image Denoising with Feature Attention
    Anwar, Saeed
    Barnes, Nick
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3155 - 3164
  • [6] Unprocessing Images for Learned Raw Denoising
    Brooks, Tim
    Mildenhall, Ben
    Xue, Tianfan
    Chen, Jiawen
    Sharlet, Dillon
    Barron, Jonathan T.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11028 - 11037
  • [7] Bychkovsky V, 2011, PROC CVPR IEEE, P97
  • [8] Chan K. C. K., 2020, ARXIVABS200907265
  • [9] Learning to See in the Dark
    Chen, Chen
    Chen, Qifeng
    Xu, Jia
    Koltun, Vladlen
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3291 - 3300
  • [10] Cho S, 2011, IEEE I CONF COMP VIS, P495, DOI 10.1109/ICCV.2011.6126280