TFFD-Net: an effective two-stage mixed feature fusion and detail recovery dehazing network

被引:0
作者
Li, Chen [1 ]
Yan, Weiqi [2 ]
Zhao, Hongwei [3 ]
Zhou, Shihua [1 ]
Wang, Yueping [4 ]
机构
[1] Dalian Univ, Sch Software Engn, Key Lab Adv Design & Intelligent Comp, Minist Educ, Xuefu St, Dalian 116622, Liaoning, Peoples R China
[2] Auckland Univ Technol, Sch Engn Comp & Math Sci, 55 Wellesley St East, Auckland 1010, New Zealand
[3] Dalian Univ, Sch Software Engn, Xuefu St, Dalian 116622, Liaoning, Peoples R China
[4] DHC IT Co, Lingshui St, Dalian 116085, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; Detail recovery; Feature enhancement; Feature fusion; HAZE REMOVAL; IMAGE;
D O I
10.1007/s00371-024-03642-6
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image dehazing is an effective means of improving the image quality captured in hazy weather. Although many dehazing models have produced excellent results, most of them ignore the accuracy of recovering details in haze-free images and lose some detail information during the dehazing process. To address this issue, we propose a two-stage dehazing network, TFFD-Net, dividing dehazing and detail recovery into two stages. Specifically, our model consists of four main components: haze removal sub-network (HRSN), detail recovery sub-network (DRSN), haze image guided feature correction module (FCM), and cross-stage feature fusion module (CSFFM). After the basic haze is removed from the input image by using HRSN, the haze image as the second mode is fed into the FCM along with the dehaze feature. The information-rich character of the input image is utilized to guide the adjustment and feature enhancement of the dehazing feature, and the adjusted feature is finally input into the DRSN for multiscale detail reconstruction. During this period, in order to balance the two stages of the task, we also attentively fuse the feature of the two stages through CSFFM. Preventing information loss during dehazing in the first stage limits the detail recovery performance in the second stage. Our experiments on real and synthetic haze datasets indicate that our proposed TFFD-Net attains remarkable results in both evaluation metrics and visualization in a variety of scenarios. The source code and dataset are available from https://github.com/dlulc/TFFDNet/tree/master.
引用
收藏
页码:4001 / 4016
页数:16
相关论文
共 61 条
[21]   Two-stage image denoising algorithm based on noise localization [J].
Huo, Fengcai ;
Zhang, Weihao ;
Wang, Qiong ;
Ren, Weijian .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (09) :14101-14122
[22]   Scope of validity of PSNR in image/video quality assessment [J].
Huynh-Thu, Q. ;
Ghanbari, M. .
ELECTRONICS LETTERS, 2008, 44 (13) :800-U35
[23]   AGLC-GAN: Attention-based global-local cycle-consistent generative adversarial networks for unpaired single image dehazing [J].
Jaisurya, R. S. ;
Mukherjee, Snehasis .
IMAGE AND VISION COMPUTING, 2023, 140
[24]   Two-stage learning framework for single image deraining [J].
Jiang, Rui ;
Li, Yaoshun ;
Chen, Cheng ;
Liu, Wei .
IET IMAGE PROCESSING, 2023, 17 (05) :1449-1463
[25]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[26]   Benchmarking Single-Image Dehazing and Beyond [J].
Li, Boyi ;
Ren, Wenqi ;
Fu, Dengpan ;
Tao, Dacheng ;
Feng, Dan ;
Zeng, Wenjun ;
Wang, Zhangyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :492-505
[27]   AOD-Net: All-in-One Dehazing Network [J].
Li, Boyi ;
Peng, Xiulian ;
Wang, Zhangyang ;
Xu, Jizheng ;
Feng, Dan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4780-4788
[28]   PFONet: A Progressive Feedback Optimization Network for Lightweight Single Image Dehazing [J].
Li, Shuoshi ;
Zhou, Yuan ;
Ren, Wenqi ;
Xiang, Wei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :6558-6569
[29]   MSAFF-Net: Multiscale Attention Feature Fusion Networks for Single Image Dehazing and Beyond [J].
Lin, Cunyi ;
Rong, Xianwei ;
Yu, Xiaoyan .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :3089-3100
[30]   GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing [J].
Liu, Xiaohong ;
Ma, Yongrui ;
Shi, Zhihao ;
Chen, Jun .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :7313-7322