HFMNet: Hierarchical Feature Mining Network for Low-Light Image Enhancement

被引:29
作者
Xu, Kai [1 ]
Chen, Huaian [1 ]
Tan, Xiao [1 ]
Chen, Yuxuan [1 ]
Jin, Yi [1 ,2 ]
Kan, Yan [3 ]
Zhu, Changan [1 ,2 ]
机构
[1] Univ Sci & Technol China, Sch Engn Sci, Hefei 230022, Anhui, Peoples R China
[2] Univ Sci & Technol China, Sch Data Sci, Hefei 230022, Anhui, Peoples R China
[3] Univ Sci & Technol China, Innovat Lab WuHu State Owned Factory Machining, Hefei 230022, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Image edge detection; Feature extraction; Visualization; Image enhancement; Task analysis; Image restoration; Feature mining; hierarchical supervised loss; illumination and edge features; low-light image enhancement; QUALITY ASSESSMENT; SEGMENTATION;
D O I
10.1109/TIM.2022.3181280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Images captured in low-light environments often suffer from issues related to dark illumination and damaged details, which results in poor visibility. To address these problems, existing methods have attempted to enhance the visibility of low-light images using convolutional neural networks (CNNs). However, due to the insufficient consideration of crucial features such as illumination and edge details, most of them yield unnatural illumination and blurry details. In this work, to fully exploit these features, we present a detailed analysis of the illumination and edge features of low-light images, observing that the frequency components of these two features are considerably different. Therefore, we explore the frequency distributions of the feature maps extracted from different layers of a CNN model and try to seek the best representation for the illumination and edge information. Based on this, we present a hierarchical feature mining network (HFMNet) that extracts illumination and edge features in different network layers. Specifically, we build a feature mining attention (FMA) module combined with a hierarchical supervised loss to mine crucial features in appropriate network layer. Since deep hierarchical supervision tends to cause overfitting, we introduce an unpaired adversarial loss for improving the generality of the enhancement model. Through extensive experiments and analysis, we demonstrate the advantages of the proposed network, which achieves the state-of-the-art performance in terms of image quality.
引用
收藏
页数:14
相关论文
共 59 条
[51]  
Ying Z., 2017, ARXIV PREPRINT ARXIV
[52]   A New Low-Light Image Enhancement Algorithm using Camera Response Model [J].
Ying, Zhenqiang ;
Li, Ge ;
Ren, Yurui ;
Wang, Ronggang ;
Wang, Wenmin .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :3015-3022
[53]  
Zhang W, 2018, IEEE CONF COMPUT
[54]  
Zhang Y., 2020, ARXIV 200211300
[55]   Kindling the Darkness: A Practical Low-light Image Enhancer [J].
Zhang, Yonghua ;
Zhang, Jiawan ;
Guo, Xiaojie .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :1632-1640
[56]   Loss Functions for Image Restoration With Neural Networks [J].
Zhao, Hang ;
Gallo, Orazio ;
Frosio, Iuri ;
Kautz, Jan .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2017, 3 (01) :47-57
[57]  
Zhu MF, 2020, AAAI CONF ARTIF INTE, V34, P13106
[58]   To See in the Dark: N2DGAN for Background Modeling in Nighttime Scene [J].
Zhu, Zhenfeng ;
Meng, Yingying ;
Kong, Deqiang ;
Zhang, Xingxing ;
Guo, Yandong ;
Zhao, Yao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) :492-502
[59]  
Zuiderveld K., 1994, GRAPHICS GEMS, P474, DOI DOI 10.1016/B978-0-12-336156-1.50061-6