LACN: A lightweight attention-guided ConvNeXt network for low-light image enhancement

被引:41
作者
Fan, Saijie [1 ]
Liang, Wei [1 ]
Ding, Derui [1 ]
Yu, Hui [2 ]
机构
[1] Univ Shanghai Sci & Technol, Dept Control Sci & Engn, Shanghai 200093, Peoples R China
[2] Univ Portsmouth, Sch Creat Technol, Portsmouth PO1 2DJ, England
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; ConvNeXt networks; Selective kernel attention modules; Feature fusion; ADAPTIVE HISTOGRAM EQUALIZATION; RETINEX;
D O I
10.1016/j.engappai.2022.105632
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Images captured under low-light conditions usually have poor visual quality, and hence greatly reduce the accuracy of subsequent tasks such as image segmentation and detection. In the low-light image enhancement task, noises in the dark areas are generally amplified while the images' brightness is enhanced. It should be pointed out that many deep learning methods cannot effectively suppress the noise at this stage and capture important feature information. To address the above problem, this paper proposes a Lightweight Attention -guided ConvNeXt Network (LACN) for low-light image enhancement. A novel Attention ConvNeXt Module (ACM) is first proposed by introducing a parameter-free attention module (i.e. SimAM) into the ConvNeXt backbone network. Then, a nontrivial lightweight network LACN based on a multi-attention mechanism is established through stacking two ACMs and fusing their features. In what follows, an improved hybrid attention mechanism, Selective Kernel Attention Module (SKAM), is adopted to effectively extract both global and local information. Such a module realizes the evaluation of lighting conditions for the whole image and the adaptive adjustment of the receptive field. Finally, through the feature fusion module, the features of different stages are aggregated to improve the ability of network to retain color information. Numerous experiments on low -light image enhancement are implemented via comparison with other state-of-the-art methods. Experiments show that the proposed method significantly improves the brightness and contrast of low-illumination images, preserves color information, and suppresses the generation of noises after image brightening.
引用
收藏
页数:11
相关论文
共 54 条
[1]   A lightweight vehicles detection network model based on YOLOv5 [J].
Dong, Xudong ;
Yan, Shuai ;
Duan, Chaoqun .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 113
[2]  
Fan CM, 2022, Arxiv, DOI arXiv:2203.01296
[3]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[4]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[5]  
Hai J, 2021, Arxiv, DOI [arXiv:2106.14501, DOI 10.48550/ARXIV.2106.14501]
[6]   Deep Back-Projection Networks For Super-Resolution [J].
Haris, Muhammad ;
Shakhnarovich, Greg ;
Ukita, Norimichi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1664-1673
[7]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[8]   A survey on sliding mode control for networked control systems [J].
Hu, Jun ;
Zhang, Hongxu ;
Liu, Hongjian ;
Yu, Xiaoyang .
INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2021, 52 (06) :1129-1147
[9]   EnlightenGAN: Deep Light Enhancement Without Paired Supervision [J].
Jiang, Yifan ;
Gong, Xinyu ;
Liu, Ding ;
Cheng, Yu ;
Fang, Chen ;
Shen, Xiaohui ;
Yang, Jianchao ;
Zhou, Pan ;
Wang, Zhangyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :2340-2349
[10]   A multiscale retinex for bridging the gap between color images and the human observation of scenes [J].
Jobson, DJ ;
Rahman, ZU ;
Woodell, GA .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (07) :965-976