Cross-Image Disentanglement for Low-Light Enhancement in Real World

被引:5
作者
Guo, Lanqing [1 ]
Wan, Renjie [2 ]
Yang, Wenhan [3 ]
Kot, Alex C. [1 ]
Wen, Bihan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Jurong West 639798, Singapore
[2] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518055, Peoples R China
关键词
Training; Lighting; Brightness; Reflectivity; Task analysis; Feature extraction; Image enhancement; Low-light enhancement; image restoration; disentanglement; MISALIGNMENT; NETWORKS; RETINEX; SPARSE;
D O I
10.1109/TCSVT.2023.3303574
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e.g., real noise. Existing supervised algorithms for low-light image enhancement require a large set of pixel-aligned training image pairs, which are hard to prepare in practice. Though some recent unsupervised methods can alleviate such data challenges, many real world artifacts inevitably get falsely amplified in the enhanced results due to the lack of corresponding supervision. In this paper, instead of using perfectly aligned images for training, we creatively employ the misaligned real world images as the guidance, which are considerably easier to collect. Specifically, we propose a Cross-Image Disentanglement Network (CIDN) with weakly supervised learning, to separately extract cross-image brightness and image-specific content features from low/normal-light images. Based on that, CIDN can simultaneously correct the brightness and suppress image artifacts in the feature domain, which largely increases the robustness of the pixel shifts between training pairs. By considering real world corruptions, we propose a new training dataset with misaligned and noisy image pairs and its corresponding evaluation dataset. Experimental results show that our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets. The code implementation is publicly available at: https://github.com/GuoLanqing/CIDN.
引用
收藏
页码:2550 / 2563
页数:14
相关论文
共 50 条
  • [41] Low-Light Image Enhancement With Regularized Illumination Optimization and Deep Noise Suppression
    Guo, Yu
    Lu, Yuxu
    Liu, Ryan Wen
    Yang, Meifang
    Chui, Kwok Tai
    IEEE ACCESS, 2020, 8 (145297-145315): : 145297 - 145315
  • [42] A survey on image enhancement for Low-light images
    Guo, Jiawei
    Ma, Jieming
    Garcia-Fernandez, Angel F.
    Zhang, Yungang
    Liang, Haining
    HELIYON, 2023, 9 (04)
  • [43] Retinex-Based Variational Framework for Low-Light Image Enhancement and Denoising
    Ma, Qianting
    Wang, Yang
    Zeng, Tieyong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5580 - 5588
  • [44] Multi-Scale Progressive Fusion Network for Low-Light Image Enhancement
    Zhang, Hongxin
    Ran, Teng
    Xiao, Wendong
    Lv, Kai
    Peng, Song
    Yuan, Liang
    Wang, Jingchuan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [45] Low-Light Image Enhancement by Retinex-Based Algorithm Unrolling and Adjustment
    Liu, Xinyi
    Xie, Qi
    Zhao, Qian
    Wang, Hong
    Meng, Deyu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15758 - 15771
  • [46] SCNet: A Self-Calibrating Unsupervised Low-Light Image Enhancement Network
    Zhang, Runze
    Yao, Shuanglong
    Lu, Liang
    Wang, Xing
    IEEE SENSORS JOURNAL, 2023, 23 (24) : 30765 - 30772
  • [47] RetinexDIP: A Unified Deep Framework for Low-Light Image Enhancement
    Zhao, Zunjin
    Xiong, Bangshu
    Wang, Lei
    Ou, Qiaofeng
    Yu, Lei
    Kuang, Fa
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1076 - 1088
  • [48] Interpretable Optimization-Inspired Unfolding Network for Low-Light Image Enhancement
    Wu, Wenhui
    Weng, Jian
    Zhang, Pingping
    Wang, Xu
    Yang, Wenhan
    Jiang, Jianmin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) : 2545 - 2562
  • [49] Glow in the Dark: Low-Light Image Enhancement With External Memory
    Ye, Dongjie
    Ni, Zhangkai
    Yang, Wenhan
    Wang, Hanli
    Wang, Shiqi
    Kwong, Sam
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2148 - 2163
  • [50] Multiscale Low-Light Image Enhancement Network With Illumination Constraint
    Fan, Guo-Dong
    Fan, Bi
    Gan, Min
    Chen, Guang-Yong
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7403 - 7417