CSPN: A Category-Specific Processing Network for Low-Light Image Enhancement

被引:8
作者
Wu, Hongjun [1 ]
Wang, Chenxi [1 ]
Tu, Luwei [1 ]
Patsch, Constantin [2 ]
Jin, Zhi [3 ,4 ]
机构
[1] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen Campus, Shenzhen 518107, Guangdong, Peoples R China
[2] Tech Univ Munich, Munich Inst Robot & Machine Intelligence, TUM Sch Computat Informat & Technol, Chair Media Technol, D-80333 Munich, Germany
[3] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen Campus, Shenzhen 518107, Guangdong, Peoples R China
[4] Guangdong Prov Key Lab Fire Sci & Technol, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; category-specific processing; GLCM entropy; wavelet transform;
D O I
10.1109/TCSVT.2024.3426527
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in low-light conditions usually suffer from degradation problems. Recently, numerous deep learning-based methods are proposed for low-light image enhancement. They either focus on performance improvement with negligence of computational complicity, or are extremely computationally efficient networks with poor performance. In this work, we intend to figure out a solution, which strikes a balance between computational cost and performance. Moreover, we observe that different regions of an image contain different amounts of information, where the region with less information is easier to restore than that with more information. Hence, we propose to crop a low-light image into patches and classify these patches into "simple", "medium" and "hard" categories based on their involved information. Then, we enhance different patch categories with different network complexities, therefore, a Category-specific Processing Network (CSPN) is proposed to achieve the computational complexity and performance balance. The patch classification is implemented by the proposed Grey-Level Co-occurrence Matrix (GLCM) entropy-based algorithm, which measures the content complexity of an image by analyzing the statistics of the difference between pixels. As the frequency domain contains exclusive feature information that is beneficial for improving image quality, the wavelet transform is introduced during the enhancement. Extensive experimental results demonstrate the superiority of our proposed CSPN over other state-of-the-art methods in various datasets with the least amount of computational cost.
引用
收藏
页码:11929 / 11941
页数:13
相关论文
共 52 条
[1]   ANALYSIS OF THE RETINEX THEORY OF COLOR-VISION [J].
BRAINARD, DH ;
WANDELL, BA .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1986, 3 (10) :1651-1661
[2]   MEAN SHIFT, MODE SEEKING, AND CLUSTERING [J].
CHENG, YZ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1995, 17 (08) :790-799
[3]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[4]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[5]   Low-light Image Enhancement via Breaking Down the Darkness [J].
Guo, Xiaojie ;
Hu, Qiming .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (01) :48-66
[6]   R2RNet: Low-light image enhancement via Real-low to Real-normal Network [J].
Hai, Jiang ;
Xuan, Zhu ;
Yang, Ren ;
Hao, Yutong ;
Zou, Fengzhu ;
Lin, Fang ;
Han, Songchen .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
[7]   TEXTURAL FEATURES FOR IMAGE CLASSIFICATION [J].
HARALICK, RM ;
SHANMUGAM, K ;
DINSTEIN, I .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1973, SMC3 (06) :610-621
[8]   Wavelet Domain Generative Adversarial Network for Multi-scale Face Hallucination [J].
Huang, Huaibo ;
He, Ran ;
Sun, Zhenan ;
Tan, Tieniu .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (6-7) :763-784
[9]   ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic [J].
Kong, Xiangtao ;
Zhao, Hengyuan ;
Qiao, Yu ;
Dong, Chao .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12011-12020
[10]   Contrast Enhancement Based on Layered Difference Representation of 2D Histograms [J].
Lee, Chulwoo ;
Lee, Chul ;
Kim, Chang-Su .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (12) :5372-5384