Low-Light Image Enhancement by Retinex-Based Algorithm Unrolling and Adjustment

被引:35
作者
Liu, Xinyi [1 ]
Xie, Qi [1 ]
Zhao, Qian [1 ]
Wang, Hong [2 ]
Meng, Deyu [1 ,3 ,4 ,5 ]
机构
[1] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Shaanxi, Peoples R China
[2] Tencent, Jarvis Lab, Shenzhen 518020, Peoples R China
[3] Xi An Jiao Tong Univ, Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Shaanxi, Peoples R China
[4] Pazhou Lab Huangpu, Guangzhou 510555, Guangdong, Peoples R China
[5] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa, Macao, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Reflectivity; Deep learning; Brightness; Pipelines; Image enhancement; Degradation; Algorithm unrolling; deep learning; low-light image enhancement (LIE); Retinex theory; ADAPTIVE HISTOGRAM EQUALIZATION; GAMMA CORRECTION; NETWORK;
D O I
10.1109/TNNLS.2023.3289626
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement (LIE) has attracted tremendous research interests in recent years. Retinex theory-based deep learning methods, following a decomposition-adjustment pipeline, have achieved promising performance due to their physical interpretability. However, existing Retinex-based deep learning methods are still suboptimal, failing to leverage useful insights from traditional approaches. Meanwhile, the adjustment step is either oversimplified or overcomplicated, resulting in unsatisfactory performance in practice. To address these issues, we propose a novel deep-learning framework for LIE. The framework consists of a decomposition network (DecNet) inspired by algorithm unrolling and adjustment networks considering both global and local brightness. The algorithm unrolling allows the integration of both implicit priors learned from data and explicit priors inherited from traditional methods, facilitating better decomposition. Meanwhile, considering global and local brightness guides the design of effective yet lightweight adjustment networks. Moreover, we introduce a self-supervised fine-tuning strategy that achieves promising performance without manual hyperparameter tuning. Extensive experiments on benchmark LIE datasets demonstrate the superiority of our approach over existing state-of-the-art methods both quantitatively and qualitatively. Code is available at <uri>https://github.com/Xinyil256/RAUNA2023</uri>.
引用
收藏
页码:15758 / 15771
页数:14
相关论文
共 77 条
[31]   Benchmarking Low-Light Image Enhancement and Beyond [J].
Liu, Jiaying ;
Xu, Dejia ;
Yang, Wenhan ;
Fan, Minhao ;
Huang, Haofeng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (04) :1153-1184
[32]   Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement [J].
Liu, Risheng ;
Ma, Long ;
Zhang, Jiaao ;
Fan, Xin ;
Luo, Zhongxuan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10556-10565
[33]   LLNet: A deep autoencoder approach to natural low-light image enhancement [J].
Lore, Kin Gwn ;
Akintayo, Adedotun ;
Sarkar, Soumik .
PATTERN RECOGNITION, 2017, 61 :650-662
[34]   TBEFN: A Two-Branch Exposure-Fusion Network for Low-Light Image Enhancement [J].
Lu, Kun ;
Zhang, Lihong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :4093-4105
[35]  
Lv F, 2018, Bmvc
[36]   Fast Enhancement for Non-Uniform Illumination Images using Light-weight CNNs [J].
Lv, Feifan ;
Liu, Bo ;
Lu, Feng .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :1450-1458
[37]   Toward Fast, Flexible, and Robust Low-Light Image Enhancement [J].
Ma, Long ;
Ma, Tengyu ;
Liu, Risheng ;
Fan, Xin ;
Luo, Zhongxuan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5627-5636
[38]   Learning Deep Context-Sensitive Decomposition for Low-Light Image Enhancement [J].
Ma, Long ;
Liu, Risheng ;
Zhang, Jiaao ;
Fan, Xin ;
Luo, Zhongxuan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) :5666-5680
[39]   Making a "Completely Blind" Image Quality Analyzer [J].
Mittal, Anish ;
Soundararajan, Rajiv ;
Bovik, Alan C. .
IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (03) :209-212
[40]   Deep Generalized Unfolding Networks for Image Restoration [J].
Mou, Chong ;
Wang, Qian ;
Zhang, Jian .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17378-17389