Scale-progressive Multi-patch Network for image dehazing

被引:4
作者
Zhang, Dan [1 ]
Zhou, Jingchun [2 ]
Zhang, Dehuan [2 ]
Qi, Pengfei [3 ]
机构
[1] Huizhou Univ, Sch Comp Sci & Engn, 46 Yanda Rd, Huizhou 516007, Peoples R China
[2] Dalian Maritime Univ, Sch Informat Sci & Technol, 1 Linghai Rd, Dalian 116026, Peoples R China
[3] Nanyang Technol Univ, Sch Elect & Elect Engn, 50 Nanyang Ave, Singapore 639798, Singapore
关键词
Image dehazing; Image restoration; Multi-scale CNN; Multi-patch CNN;
D O I
10.1016/j.image.2023.117023
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image dehazing is a classical vision task, which aims to recover a clean image from a hazy one. Previous dehazing methods usually follow a coarse-to-fine architecture to mine clean features by introducing generic CNNs components. However, this manner usually results in undesirable model complexity and computational burden. In this work, we present a Scale-progressive Multi-patch Network (SPM-Net) to handle common problems in previous dehazing networks. Specifically, our approach utilizes a scale-progressive multi-patch mechanism to efficiently model uneven hazy distribution on local patches and progressively explore clean cues in multiple scales in a fine-to-coarse way. Besides of above, we found the feature misalignment problem in the patch-based methods, and a practical solution is proposed to handle this previously neglected problem. A comprehensive evaluation of both synthetic datasets and real-world datasets demonstrates that the proposed dehazing method surpasses the previous state-of-the-art approaches with a margin both quantitatively and qualitatively. Our proposed SPM-Net achieved a PSNR of 29.47 dB on the Haze4k dataset, significantly surpassing the previous state-of-the-art method DMT-Net (29.47 dB vs. 28.53 dB) while having much fewer parameters than DMT-Net (16.1 M vs. 54.9 M) and faster inferencing efficiency (0.072 s vs. 0.192 s).
引用
收藏
页数:10
相关论文
共 37 条
[1]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[2]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[3]   Local patchwise minimal and maximal values prior for single optical remote sensing image dehazing [J].
Han, Jie ;
Zhang, Songlin ;
Fan, Ningxin ;
Ye, Zhen .
INFORMATION SCIENCES, 2022, 606 :173-193
[4]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[5]   Distilling Image Dehazing with Heterogeneous Task Imitation [J].
Hong, Ming ;
Xie, Yuan ;
Li, Cuihua ;
Qu, Yanyun .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3459-3468
[6]   NMS by Representative Region: Towards Crowded Pedestrian Detection by Proposal Pairing [J].
Huang, Xin ;
Ge, Zheng ;
Jie, Zequn ;
Yoshie, Osamu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :10747-10756
[7]  
Katiyar K, 2016, International Journal of Computer Applications, V141, P37, DOI [10.5120/ijca2016909827, 10.5120/ijca2016909827, DOI 10.5120/IJCA2016909827]
[8]   Benchmarking Single-Image Dehazing and Beyond [J].
Li, Boyi ;
Ren, Wenqi ;
Fu, Dengpan ;
Tao, Dacheng ;
Feng, Dan ;
Zeng, Wenjun ;
Wang, Zhangyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :492-505
[9]   AOD-Net: All-in-One Dehazing Network [J].
Li, Boyi ;
Peng, Xiulian ;
Wang, Zhangyang ;
Xu, Jizheng ;
Feng, Dan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4780-4788
[10]   Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining [J].
Li, Xia ;
Wu, Jianlong ;
Lin, Zhouchen ;
Liu, Hong ;
Zha, Hongbin .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :262-277