IPDNet: A dual convolutional network combined with image prior for single image dehazing

被引:9
作者
Chen, Yan [1 ]
Lyu, Zhiyu [1 ]
Hou, Yimin [1 ]
机构
[1] Northeast Elect Power Univ, Sch Automation Engn, Jilin, Peoples R China
关键词
Image dehazing; Image prior; CNN; Atmospheric scattering model; FA block;
D O I
10.1016/j.engappai.2023.106782
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dehazing based on deep learning neural networks (CNNs) has achieved remarkable results. However, the most existing dehazing CNNs perform well only on synthetic images and struggle with realistic hazy images. Moreover, training complex dehazing models is challenging due to the limited availability of realistic image datasets, leading to suboptimal performance. For this purpose, we develop a novel Image Prior Dehazing Network called IPDNet to tackle the challenge of dehazing realistic images with limited training data. The IPDNet comprises two sub-networks and a learnable fusion block. The global and local features are obtained by atmospheric scattering and direct mapping via two sub-networks with a sparse mechanism. And the learnable fusion block is settled to acquire the optimal fusion solution to improve the dehazing quality. The IPDNet offers several benefits: (1) a dual network with a learnable fusion block can effectively generate high-quality dehazed images at low computational cost; (2) an image preprocessing block based on dehazing prior can acquires the salient features of realistic hazy image, enhancing the dehazing performance on realistic hazy images; (3) the sub-network is designed by incorporating a feature attention (FA) block into the U-net structure, allowing flexible feature extraction on limited datasets. Extensive experiments on SOTS, NH-HAZE, and DENSE-HAZE datasets show that IPDNet outperforms other state-of-the-art methods on synthetic and realistic datasets. Specifically, our model achieved an improvement of approximately 0.84 dB in PSNR and 11.6% in SSIM, demonstrating its effectiveness in realistic scenarios, which contributes to improving traffic safety in adverse weather conditions.
引用
收藏
页数:12
相关论文
共 42 条
[1]   Hercules: Deep Hierarchical Attentive Multilevel Fusion Model With Uncertainty Quantification for Medical Image Classification [J].
Abdar, Moloud ;
Fahami, Mohammad Amin ;
Rundo, Leonardo ;
Radeva, Petia ;
Frangi, Alejandro F. ;
Acharya, U. Rajendra ;
Khosravi, Abbas ;
Lam, Hak-Keung ;
Jung, Alexander ;
Nahavandi, Saeid .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) :274-285
[2]   Underwater image dehazing using global color features [J].
Alenezi, Fayadh ;
Armghan, Ammar ;
Santosh, K. C. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
[3]  
Ancuti C.O., 2019, P IEEECVF C COMPUTER
[4]   NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1798-1805
[5]   NTIRE 2020 Challenge on NonHomogeneous Dehazing [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Vasluianu, Florin-Alexandru ;
Timofte, Radu ;
Liu, Jing ;
Wu, Haiyan ;
Xie, Yuan ;
Qu, Yanyun ;
Ma, Lizhuang ;
Huang, Ziling ;
Deng, Qili ;
Chao, Ju-Chin ;
Yang, Tsung-Shan ;
Chen, Peng-Wen ;
Hsu, Po-Min ;
Liao, Tzu-Yi ;
Sun, Chung-En ;
Wu, Pei-Yuan ;
Do, Jeonghyeok ;
Park, Jongmin ;
Kim, Munchurl ;
Metwaly, Kareem ;
Li, Xuelu ;
Guo, Tiantong ;
Monga, Vishal ;
Yu, Mingzhao ;
Cherukuri, Venkateswararao ;
Chuang, Shiue-Yuan ;
Lin, Tsung-Nan ;
Lee, David ;
Chang, Jerome ;
Wang, Zhan-Han ;
Chang, Yu-Bang ;
Lin, Chang-Hong ;
Dong, Yu ;
Zhou, Hongyu ;
Kong, Xiangzhen ;
Das, Sourya Dipta ;
Dutta, Saikat ;
Zhao, Xuan ;
Ouyang, Bing ;
Estrada, Dennis ;
Wang, Meiqi ;
Su, Tianqi ;
Chen, Siyi ;
Sun, Bangyong ;
de Dravo, Vincent Whannou ;
Yu, Zhe ;
Narang, Pratik ;
Mehra, Aryan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2029-2044
[6]  
Ancuti CO, 2019, IEEE IMAGE PROC, P1014, DOI [10.1109/ICIP.2019.8803046, 10.1109/icip.2019.8803046]
[7]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[8]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[9]   Dehazing Using Color-Lines [J].
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2014, 34 (01)
[10]   D3-Net: Integrated multi-task convolutional neural network for water surface deblurring, dehazing and object detection [J].
Guo, Jundong ;
Feng, Hui ;
Xu, Haixiang ;
Yu, Wenzhao ;
Ge, Sam shuzhi .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 117