Cross-Image Disentanglement for Low-Light Enhancement in Real World

被引:7
作者
Guo, Lanqing [1 ]
Wan, Renjie [2 ]
Yang, Wenhan [3 ]
Kot, Alex C. [1 ]
Wen, Bihan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Jurong West 639798, Singapore
[2] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518055, Peoples R China
关键词
Training; Lighting; Brightness; Reflectivity; Task analysis; Feature extraction; Image enhancement; Low-light enhancement; image restoration; disentanglement; MISALIGNMENT; NETWORKS; RETINEX; SPARSE;
D O I
10.1109/TCSVT.2023.3303574
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e.g., real noise. Existing supervised algorithms for low-light image enhancement require a large set of pixel-aligned training image pairs, which are hard to prepare in practice. Though some recent unsupervised methods can alleviate such data challenges, many real world artifacts inevitably get falsely amplified in the enhanced results due to the lack of corresponding supervision. In this paper, instead of using perfectly aligned images for training, we creatively employ the misaligned real world images as the guidance, which are considerably easier to collect. Specifically, we propose a Cross-Image Disentanglement Network (CIDN) with weakly supervised learning, to separately extract cross-image brightness and image-specific content features from low/normal-light images. Based on that, CIDN can simultaneously correct the brightness and suppress image artifacts in the feature domain, which largely increases the robustness of the pixel shifts between training pairs. By considering real world corruptions, we propose a new training dataset with misaligned and noisy image pairs and its corresponding evaluation dataset. Experimental results show that our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets. The code implementation is publicly available at: https://github.com/GuoLanqing/CIDN.
引用
收藏
页码:2550 / 2563
页数:14
相关论文
共 76 条
[1]   A dynamic histogram equalization for image contrast enhancement [J].
Abdullah-Al-Wadud, M. ;
Kabir, Md. Hasanul ;
Dewan, M. Ali Akber ;
Chae, Oksam .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (02) :593-600
[2]   CONTEXTUAL COLORIZATION AND DENOISING FOR LOW-LIGHT ULTRA HIGH RESOLUTION SEQUENCES [J].
Anantrasirichai, N. ;
Bull, David .
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, :1614-1618
[3]   RENOIR - A dataset for real low-light image noise reduction [J].
Anaya, Josue ;
Barbu, Adrian .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 51 :144-154
[4]  
[Anonymous], 2014, P ADV NEUR INF PROC, V27, P1
[5]   DEN: Disentanglement and Enhancement Networks for Low Illumination Images [J].
Bow, Nelson Chong Ngee ;
Vu-Hoang Tran ;
Kerdsiri, Punchok ;
Loh, Yuen Peng ;
Huang, Ching-Chun .
2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, :419-422
[6]   Learning to See in the Dark [J].
Chen, Chen ;
Chen, Qifeng ;
Xu, Jia ;
Koltun, Vladlen .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3291-3300
[7]  
Chen X, 2016, 30 C NEURAL INFORM P, V29
[8]  
Cheng H., 2021, arXiv
[9]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[10]   Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance-chrominance space [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, :313-316