Low-Light Homomorphic Filtering Network for integrating image enhancement and classification

被引:32
作者
Al Sobbahi, Rayan [1 ]
Tekli, Joe [1 ,2 ]
机构
[1] Lebanese Amer Univ LAU, Dept Elect & Comp Engn, 36 Byblos, Beirut, Lebanon
[2] Univ Pay & Pays Adour UPPA, SPIDER Res Team, LIUPPA Lab, F-64600 Aquitaine, France
关键词
Image enhancement; Low-light conditions; Deep learning; Object classification; Homomorphic filtering;
D O I
10.1016/j.image.2021.116527
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Low-light image (LLI) enhancement techniques have recently demonstrated remarkable progress especially with the use of deep learning approaches. However, most existing techniques are developed as standalone solutions and do not take into account the impact of LLI enhancement on high-level computer vision tasks like object classification. In this paper, we propose a new LLI enhancement model titled LLHFNet (Low light Homomorphic Filtering Network) which performs image-to-frequency filter learning and is designed for seamless integration into classification models. Through this integration, the classification model is embedded with an internal enhancement capability and is jointly trained to optimize both image enhancement and classification performance. We have conducted a large battery of experiments using SICE, Pascal VOC, and ExDark datasets, to quantitatively and qualitatively evaluate our approach's enhancement quality and classification performance. When evaluated as a standalone enhancement model, our solution consistently ranks among the best existing image enhancement techniques. When embedded with a classification model, our solution achieves an average 5.5% improvement in classification accuracy, compared with the traditional pipeline of separate enhancement followed by classification. Results produce robust classification quality on both LLIs and normal-light images (NLIs), and highlight a clear improvement to the literature.
引用
收藏
页数:12
相关论文
共 55 条
[1]   A dynamic histogram equalization for image contrast enhancement [J].
Abdullah-Al-Wadud, M. ;
Kabir, Md. Hasanul ;
Dewan, M. Ali Akber ;
Chae, Oksam .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (02) :593-600
[2]  
Al Sobbahi R., 2021, J VISUAL COMMUN IMAG
[3]  
[Anonymous], 2017, 2017 IEEE VISUAL COM
[4]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[5]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[6]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[7]   Autonomous UAV Trajectory for Localizing Ground Objects: A Reinforcement Learning Approach [J].
Ebrahimi, Dariush ;
Sharafeddine, Sanaa ;
Ho, Pin-Han ;
Assi, Chadi .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (04) :1312-1324
[8]  
Everingham M., 2010, International journal of computer vision, V88, P303, DOI DOI 10.1007/s11263-009-0275-4
[9]   A weighted variational model for simultaneous reflectance and illumination estimation [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Zhang, Xiao-Ping ;
Ding, Xinghao .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2782-2790
[10]  
Gonzalez R. C., 2018, Digital image processing