Low-Light Image Enhancement by Retinex-Based Algorithm Unrolling and Adjustment

被引:35
作者
Liu, Xinyi [1 ]
Xie, Qi [1 ]
Zhao, Qian [1 ]
Wang, Hong [2 ]
Meng, Deyu [1 ,3 ,4 ,5 ]
机构
[1] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Shaanxi, Peoples R China
[2] Tencent, Jarvis Lab, Shenzhen 518020, Peoples R China
[3] Xi An Jiao Tong Univ, Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Shaanxi, Peoples R China
[4] Pazhou Lab Huangpu, Guangzhou 510555, Guangdong, Peoples R China
[5] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa, Macao, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Reflectivity; Deep learning; Brightness; Pipelines; Image enhancement; Degradation; Algorithm unrolling; deep learning; low-light image enhancement (LIE); Retinex theory; ADAPTIVE HISTOGRAM EQUALIZATION; GAMMA CORRECTION; NETWORK;
D O I
10.1109/TNNLS.2023.3289626
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement (LIE) has attracted tremendous research interests in recent years. Retinex theory-based deep learning methods, following a decomposition-adjustment pipeline, have achieved promising performance due to their physical interpretability. However, existing Retinex-based deep learning methods are still suboptimal, failing to leverage useful insights from traditional approaches. Meanwhile, the adjustment step is either oversimplified or overcomplicated, resulting in unsatisfactory performance in practice. To address these issues, we propose a novel deep-learning framework for LIE. The framework consists of a decomposition network (DecNet) inspired by algorithm unrolling and adjustment networks considering both global and local brightness. The algorithm unrolling allows the integration of both implicit priors learned from data and explicit priors inherited from traditional methods, facilitating better decomposition. Meanwhile, considering global and local brightness guides the design of effective yet lightweight adjustment networks. Moreover, we introduce a self-supervised fine-tuning strategy that achieves promising performance without manual hyperparameter tuning. Extensive experiments on benchmark LIE datasets demonstrate the superiority of our approach over existing state-of-the-art methods both quantitatively and qualitatively. Code is available at <uri>https://github.com/Xinyil256/RAUNA2023</uri>.
引用
收藏
页码:15758 / 15771
页数:14
相关论文
共 77 条
[1]  
Acharya T, 2005, IMAGE PROCESSING: PRINCIPLES AND APPLICATIONS, P1, DOI 10.1002/0471745790
[2]  
[Anonymous], 1994, GRAPHICS GEMS
[3]  
Boyd S., 2004, Convex Optimization
[4]  
Bychkovsky V, 2011, PROC CVPR IEEE, P97
[5]   PSD: Principled Synthetic-to-Real Dehazing Guided by Physical Priors [J].
Chen, Zeyuan ;
Wang, Yangchao ;
Yang, Yang ;
Liu, Dong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :7176-7185
[6]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[7]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[8]   Integrating Semantic Segmentation and Retinex Model for Low Light Image Enhancement [J].
Fan, Minhao ;
Wang, Wenjing ;
Yang, Wenhan ;
Liu, Jiaying .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :2317-2325
[9]   Learning Dual Priors for JPEG Compression Artifacts Removal [J].
Fu, Xueyang ;
Wang, Xi ;
Liu, Aiping ;
Han, Junwei ;
Zha, Zheng-Jun .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4066-4075
[10]   A Model-Driven Deep Unfolding Method for JPEG Artifacts Removal [J].
Fu, Xueyang ;
Wang, Menglu ;
Cao, Xiangyong ;
Ding, Xinghao ;
Zha, Zheng-Jun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) :6802-6816