Revisiting coarse-to-fine strategy for low-light image enhancement with deep decomposition guided training

被引:5
作者
Jiang, Hai [1 ]
Ren, Yang [1 ]
Han, Songchen [1 ]
机构
[1] Sichuan Univ, Sch Aeronaut & Astronaut, Chengdu 610065, Peoples R China
关键词
Low-light image enhancement; Coarse-to-fine restoration; Light-head and heavy-tail network; Retinex theory; QUALITY ASSESSMENT; NETWORK;
D O I
10.1016/j.cviu.2024.103952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Previous coarse -to -fine strategies typically spend equal effort in feature extraction and feature reconstruction, and gradually improve the brightness of images from bottom to top, resulting in computational resources not being well consumed for restoration. In this paper, we propose a new deep framework for Robust and Fast Low -Light Image Enhancement, dubbed RFLLIE. Specifically, we first use a lightweight CNN encoder consisting of a few convolutional layers and pooling layers to form a feature pyramid for restoration. Then, a coarseto -fine recovery module, which consists of cascaded depth blocks and well -designed spatial attention layers as well as progressive dilation Resblocks, is proposed for feature aggregation and global -to -local restoration. As such, our RFLLIE is formed as a light -head and heavy -tail architecture that focuses more on feature reconstruction rather than extraction. Additionally, we propose a decomposition -guided restoration loss based on the Retinex theory that adopts the "enhancement before decomposition"strategy instead of the commonly used "decomposition before enhancement'' to further improve the contrast and suppress noise. Extensive experiments demonstrate that our method outperforms the existing state-of-the-art methods both quantitatively and visually, and achieves a better trade-off between performance and efficiency. Our code will be available at https://github.com/JianghaiSCU/RFLLIE.
引用
收藏
页数:12
相关论文
共 74 条
[11]   A fusion-based enhancing method for weakly illuminated images [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Liao, Yinghao ;
Ding, Xinghao ;
Paisley, John .
SIGNAL PROCESSING, 2016, 129 :82-96
[12]   Learning a Simple Low-light Image Enhancer from Paired Low-light Instances [J].
Fu, Zhenqi ;
Yang, Yan ;
Tu, Xiaotong ;
Huang, Yue ;
Ding, Xinghao ;
Ma, Kai-Kuang .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :22252-22261
[13]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[14]   Low-light Image Enhancement via Breaking Down the Darkness [J].
Guo, Xiaojie ;
Hu, Qiming .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (01) :48-66
[15]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993
[16]  
Hai J., 2022, Signal Process., Image Commun
[17]   R2RNet: Low-light image enhancement via Real-low to Real-normal Network [J].
Hai, Jiang ;
Xuan, Zhu ;
Yang, Ren ;
Hao, Yutong ;
Zou, Fengzhu ;
Lin, Fang ;
Han, Songchen .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
[18]   A Visual Navigation System for UAV under Diverse Illumination Conditions [J].
Hai, Jiang ;
Hao, Yutong ;
Zou, Fengzhu ;
Lin, Fang ;
Han, Songchen .
APPLIED ARTIFICIAL INTELLIGENCE, 2021, 35 (15) :1529-1549
[19]   Low-Light Image Enhancement With Semi-Decoupled Decomposition [J].
Hao, Shijie ;
Han, Xu ;
Guo, Yanrong ;
Xu, Xin ;
Wang, Meng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (12) :3025-3038
[20]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778