HFMNet: Hierarchical Feature Mining Network for Low-Light Image Enhancement

被引:25
作者
Xu, Kai [1 ]
Chen, Huaian [1 ]
Tan, Xiao [1 ]
Chen, Yuxuan [1 ]
Jin, Yi [1 ,2 ]
Kan, Yan [3 ]
Zhu, Changan [1 ,2 ]
机构
[1] Univ Sci & Technol China, Sch Engn Sci, Hefei 230022, Anhui, Peoples R China
[2] Univ Sci & Technol China, Sch Data Sci, Hefei 230022, Anhui, Peoples R China
[3] Univ Sci & Technol China, Innovat Lab WuHu State Owned Factory Machining, Hefei 230022, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Image edge detection; Feature extraction; Visualization; Image enhancement; Task analysis; Image restoration; Feature mining; hierarchical supervised loss; illumination and edge features; low-light image enhancement; QUALITY ASSESSMENT; SEGMENTATION;
D O I
10.1109/TIM.2022.3181280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in low-light environments often suffer from issues related to dark illumination and damaged details, which results in poor visibility. To address these problems, existing methods have attempted to enhance the visibility of low-light images using convolutional neural networks (CNNs). However, due to the insufficient consideration of crucial features such as illumination and edge details, most of them yield unnatural illumination and blurry details. In this work, to fully exploit these features, we present a detailed analysis of the illumination and edge features of low-light images, observing that the frequency components of these two features are considerably different. Therefore, we explore the frequency distributions of the feature maps extracted from different layers of a CNN model and try to seek the best representation for the illumination and edge information. Based on this, we present a hierarchical feature mining network (HFMNet) that extracts illumination and edge features in different network layers. Specifically, we build a feature mining attention (FMA) module combined with a hierarchical supervised loss to mine crucial features in appropriate network layer. Since deep hierarchical supervision tends to cause overfitting, we introduce an unpaired adversarial loss for improving the generality of the enhancement model. Through extensive experiments and analysis, we demonstrate the advantages of the proposed network, which achieves the state-of-the-art performance in terms of image quality.
引用
收藏
页数:14
相关论文
共 59 条
[1]   A dynamic histogram equalization for image contrast enhancement [J].
Abdullah-Al-Wadud, M. ;
Kabir, Md. Hasanul ;
Dewan, M. Ali Akber ;
Chae, Oksam .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (02) :593-600
[2]   Deep Learning-based Distortion Sensitivity Prediction for Full-Reference Image Quality Assessment [J].
Ahn, Sewoong ;
Choi, Yeji ;
Yoon, Kwangjin .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :344-353
[3]   Two-Stage Convolutional Neural Network forMedical Noise Removal via Image Decomposition [J].
Chang, Yi ;
Yan, Luxin ;
Chen, Meiya ;
Fang, Houzhang ;
Zhong, Sheng .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (06) :2707-2721
[4]   Multiframe-to-Multiframe Network for Video Denoising [J].
Chen, Huaian ;
Jin, Yi ;
Xu, Kai ;
Chen, Yuxuan ;
Zhu, Changan .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :2164-2178
[5]   Automated cement fragment image segmentation and distribution estimation via a holistically-nested convolutional network and morphological analysis [J].
Chen, Huaian ;
Jin, Yi ;
Li, Guiqiang ;
Chu, Biao .
POWDER TECHNOLOGY, 2018, 339 :306-313
[6]  
Dong X, 2011, IEEE INT CON MULTI
[7]   A weighted variational model for simultaneous reflectance and illumination estimation [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Zhang, Xiao-Ping ;
Ding, Xinghao .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2782-2790
[8]   A fusion-based enhancing method for weakly illuminated images [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Liao, Yinghao ;
Ding, Xinghao ;
Paisley, John .
SIGNAL PROCESSING, 2016, 129 :82-96
[9]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993
[10]  
Gupta A, 2017, IEEE INT C INTELL TR