Residual Quotient Learning for Zero-Reference Low-Light Image Enhancement

被引:0
作者
Xie, Chao [1 ]
Fei, Linfeng [1 ]
Tao, Huanjie [2 ]
Hu, Yaocong [3 ]
Zhou, Wei [4 ]
Hoe, Jiun Tian [5 ]
Hu, Weipeng [5 ]
Tan, Yap-Peng [5 ]
机构
[1] Nanjing Forestry Univ, Coll Mech & Elect Engn, Nanjing 210037, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[3] Anhui Polytech Univ, Sch Elect Engn, Wuhu 241000, Peoples R China
[4] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou 510006, Guangdong, Peoples R China
[5] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Lighting; Training; Image enhancement; Chaos; Reflectivity; Optimization; Neural networks; Image restoration; Image color analysis; Face detection; Low-light image enhancement; residual quotient learning; zero reference; deep learning; NETWORK; REPRESENTATION;
D O I
10.1109/TIP.2024.3519997
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, neural networks have become the dominant approach to low-light image enhancement (LLIE), with at least one-third of them adopting a Retinex-related architecture. However, through in-depth analysis, we contend that this most widely accepted LLIE structure is suboptimal, particularly when addressing the non-uniform illumination commonly observed in natural images. In this paper, we present a novel variant learning framework, termed residual quotient learning, to substantially alleviate this issue. Instead of following the existing Retinex-related decomposition-enhancement-reconstruction process, our basic idea is to explicitly reformulate the light enhancement task as adaptively predicting the latent quotient with reference to the original low-light input using a residual learning fashion. By leveraging the proposed residual quotient learning, we develop a lightweight yet effective network called ResQ-Net. This network features enhanced non-uniform illumination modeling capabilities, making it more suitable for real-world LLIE tasks. Moreover, due to its well-designed structure and reference-free loss function, ResQ-Net is flexible in training as it allows for zero-reference optimization, which further enhances the generalization and adaptability of our entire framework. Extensive experiments on various benchmark datasets demonstrate the merits and effectiveness of the proposed residual quotient learning, and our trained ResQ-Net outperforms state-of-the-art methods both qualitatively and quantitatively. Furthermore, a practical application in dark face detection is explored, and the preliminary results confirm the potential and feasibility of our method in real-world scenarios.
引用
收藏
页码:365 / 378
页数:14
相关论文
共 50 条
[21]   LightingNet: An Integrated Learning Method for Low-Light Image Enhancement [J].
Yang, Shaoliang ;
Zhou, Dongming ;
Cao, Jinde ;
Guo, Yanbu .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 :29-42
[22]   Rethinking Zero-DCE for Low-Light Image Enhancement [J].
Mi, Aizhong ;
Luo, Wenhui ;
Qiao, Yingxu ;
Huo, Zhanqiang .
NEURAL PROCESSING LETTERS, 2024, 56 (02)
[23]   Image Intrinsic Components Guided Conditional Diffusion Model for Low-Light Image Enhancement [J].
Kang, Sicong ;
Gao, Shuaibo ;
Wu, Wenhui ;
Wang, Xu ;
Wang, Shuoyao ;
Qiu, Guoping .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) :13244-13256
[24]   Low-Light Image and Video Enhancement Using Deep Learning: A Survey [J].
Li, Chongyi ;
Guo, Chunle ;
Han, Linghao ;
Jiang, Jun ;
Cheng, Ming-Ming ;
Gu, Jinwei ;
Loy, Chen Change .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) :9396-9416
[25]   FFENet: Learning Frequency Features for Low-Light Enhancement [J].
Liu, Zhenbing ;
Gong, Junming ;
Lu, Haoxiang ;
Pan, Xipeng ;
Lan, Rushi .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
[26]   Zero-reference single underwater image enhancement [J].
Aiping Yang ;
Chaochen Wang ;
Jinbin Wang ;
Qian Wang ;
Tengfei Zhang .
Multimedia Tools and Applications, 2023, 82 :46423-46438
[27]   Zero-reference single underwater image enhancement [J].
Yang, Aiping ;
Wang, Chaochen ;
Wang, Jinbin ;
Wang, Qian ;
Zhang, Tengfei .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (30) :46423-46438
[28]   RetinexDIP: A Unified Deep Framework for Low-Light Image Enhancement [J].
Zhao, Zunjin ;
Xiong, Bangshu ;
Wang, Lei ;
Ou, Qiaofeng ;
Yu, Lei ;
Kuang, Fa .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) :1076-1088
[29]   Glow in the Dark: Low-Light Image Enhancement With External Memory [J].
Ye, Dongjie ;
Ni, Zhangkai ;
Yang, Wenhan ;
Wang, Hanli ;
Wang, Shiqi ;
Kwong, Sam .
IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 :2148-2163
[30]   PRNet: Low-Light Image Enhancement Based on Fourier Transform [J].
Zhang, Jiayu ;
Wang, Xiaohua ;
Li, Yingjian ;
Wang, Wenjie .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74