TFFD-Net: an effective two-stage mixed feature fusion and detail recovery dehazing network

被引:0
作者
Li, Chen [1 ]
Yan, Weiqi [2 ]
Zhao, Hongwei [3 ]
Zhou, Shihua [1 ]
Wang, Yueping [4 ]
机构
[1] Dalian Univ, Sch Software Engn, Key Lab Adv Design & Intelligent Comp, Minist Educ, Xuefu St, Dalian 116622, Liaoning, Peoples R China
[2] Auckland Univ Technol, Sch Engn Comp & Math Sci, 55 Wellesley St East, Auckland 1010, New Zealand
[3] Dalian Univ, Sch Software Engn, Xuefu St, Dalian 116622, Liaoning, Peoples R China
[4] DHC IT Co, Lingshui St, Dalian 116085, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; Detail recovery; Feature enhancement; Feature fusion; HAZE REMOVAL; IMAGE;
D O I
10.1007/s00371-024-03642-6
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image dehazing is an effective means of improving the image quality captured in hazy weather. Although many dehazing models have produced excellent results, most of them ignore the accuracy of recovering details in haze-free images and lose some detail information during the dehazing process. To address this issue, we propose a two-stage dehazing network, TFFD-Net, dividing dehazing and detail recovery into two stages. Specifically, our model consists of four main components: haze removal sub-network (HRSN), detail recovery sub-network (DRSN), haze image guided feature correction module (FCM), and cross-stage feature fusion module (CSFFM). After the basic haze is removed from the input image by using HRSN, the haze image as the second mode is fed into the FCM along with the dehaze feature. The information-rich character of the input image is utilized to guide the adjustment and feature enhancement of the dehazing feature, and the adjusted feature is finally input into the DRSN for multiscale detail reconstruction. During this period, in order to balance the two stages of the task, we also attentively fuse the feature of the two stages through CSFFM. Preventing information loss during dehazing in the first stage limits the detail recovery performance in the second stage. Our experiments on real and synthetic haze datasets indicate that our proposed TFFD-Net attains remarkable results in both evaluation metrics and visualization in a variety of scenarios. The source code and dataset are available from https://github.com/dlulc/TFFDNet/tree/master.
引用
收藏
页码:4001 / 4016
页数:16
相关论文
共 61 条
[1]   NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1798-1805
[2]  
Ancuti CO, 2019, IEEE IMAGE PROC, P1014, DOI [10.1109/ICIP.2019.8803046, 10.1109/icip.2019.8803046]
[3]   I-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Indoor Images [J].
Ancuti, Cosmin ;
Ancuti, Codruta O. ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2018, 2018, 11182 :620-631
[4]   Self-Guided Image Dehazing Using Progressive Feature Fusion [J].
Bai, Haoran ;
Pan, Jinshan ;
Xiang, Xinguang ;
Tang, Jinhui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1217-1229
[5]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[6]   Single Image Dehazing Using Color Ellipsoid Prior [J].
Bui, Trung Minh ;
Kim, Wonha .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) :999-1009
[7]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[8]   CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification [J].
Chen, Chun-Fu ;
Fan, Quanfu ;
Panda, Rameswar .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :347-356
[9]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383
[10]   Single-image dehazing via depth-guided deep retinex decomposition [J].
Chen, Hui ;
Chen, Rong ;
Ma, Long ;
Li, Nannan .
VISUAL COMPUTER, 2023, 39 (11) :5279-5291