Image Dehazing Algorithm Based on Deep Learning Coupled Local and Global Features

被引:11
作者
Li, Shuping [1 ]
Yuan, Qianhao [1 ]
Zhang, Yeming [1 ,2 ,3 ]
Lv, Baozhan [1 ]
Wei, Feng [1 ]
机构
[1] Henan Polytech Univ, Sch Mech & Power Engn, Jiaozuo 454000, Henan, Peoples R China
[2] Zhejiang Univ, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[3] Beijing Key Lab Pneumat Thermal Energy Storage &, Beijing 100191, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 17期
关键词
image dehazing; convolutional neural network; vision transformer; hybrid feature fusion;
D O I
10.3390/app12178552
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To address the problems that most convolutional neural network-based image defogging algorithm models capture incomplete global feature information and incomplete defogging, this paper proposes an end-to-end convolutional neural network and vision transformer hybrid image defogging algorithm. First, the shallow features of the haze image were extracted by a preprocessing module. Then, a symmetric network structure including a convolutional neural network (CNN) branch and a vision transformer branch was used to capture the local features and global features of the haze image, respectively. The mixed features were fused using convolutional layers to cover the global representation while retaining the local features. Finally, the features obtained by the encoder and decoder were fused to obtain richer feature information. The experimental results show that the proposed defogging algorithm achieved better defogging results in both the uniform and non-uniform haze datasets, solves the problems of dark and distorted colors after image defogging, and the recovered images are more natural for detail processing.
引用
收藏
页数:14
相关论文
共 21 条
[1]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[2]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383
[3]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[4]  
He Y.H., 2020, ELECT SCI TECHNOL, V33, P70
[5]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[6]   LIGHTNESS AND RETINEX THEORY [J].
LAND, EH ;
MCCANN, JJ .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1971, 61 (01) :1-&
[7]  
Li B., 2017, arXiv
[8]   AOD-Net: All-in-One Dehazing Network [J].
Li, Boyi ;
Peng, Xiulian ;
Wang, Zhangyang ;
Xu, Jizheng ;
Feng, Dan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4780-4788
[9]   Coarse-to-Fine Saliency Detection Based on Non-Subsampled Contourlet Transform Enhancement [J].
Liu Dongmei ;
Chang Faliang .
ACTA OPTICA SINICA, 2019, 39 (01)
[10]   Efficient Image Dehazing with Boundary Constraint and Contextual Regularization [J].
Meng, Gaofeng ;
Wang, Ying ;
Duan, Jiangyong ;
Xiang, Shiming ;
Pan, Chunhong .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :617-624