LFD-Net: Lightweight Feature-Interaction Dehazing Network for Real-Time Remote Sensing Tasks

被引:5
作者
Jin, Yizhu [2 ]
Chen, Jiaxing [3 ]
Tian, Feng [3 ]
Hu, Kun [1 ]
机构
[1] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Natl Innovat Ctr Intelligent & Connected Vehicles, Beijing 102607, Peoples R China
关键词
Interpretablity; model compression; real-time application; single image dehazing; IMAGE; REMOVAL;
D O I
10.1109/JSTARS.2023.3312515
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Currently, remote sensing equipments are evolving toward intelligence and integration, incorporating edge computing techniques to enable real-time responses. One of the key challenges in enhancing downstream decision-making capabilities is the preprocessing step of image dehazing. Existing dehazing methods usually suffer from steep computational costs with densely connected residual modules, as well as difficulties in maintaining visual quality. To tackle these problems, we designed a lightweight atmosphere scattering model based network structure to extract, fuse, and weight multiscale features. Our proposed LFD-Net demonstrates strong interpretability by exploiting the gated fusion module and attention mechanism to realize feature interactions between multilevel representations. The experimental results of LFD-Net on SOTS dataset reach an average frequency per second of 54.41, approximately eight times faster than seven most popular methods with equivalent metrics. After image dehazing by LFD-Net, the performance of object detection is significantly improved. The mean average precision when IoU = 0.5 (mAP@0.5) based on YOLOv5 is improved by 4.73% on DAIR-V2X dataset, which verified the practicability and adaptability of LFD-Net for real-time vision tasks.
引用
收藏
页码:9139 / 9153
页数:15
相关论文
共 57 条
[1]   O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :867-875
[2]   Self-Guided Image Dehazing Using Progressive Feature Fusion [J].
Bai, Haoran ;
Pan, Jinshan ;
Xiang, Xinguang ;
Tang, Jinhui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1217-1229
[3]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[4]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383
[5]   Dynamic Convolution: Attention over Convolution Kernels [J].
Chen, Yinpeng ;
Dai, Xiyang ;
Liu, Mengchen ;
Chen, Dongdong ;
Yuan, Lu ;
Liu, Zicheng .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11027-11036
[6]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[7]  
Duet D., 2019, P IEEE CVF INT C COM
[8]   URNet: A U-Net based residual network for image dehazing [J].
Feng, Ting ;
Wang, Chuansheng ;
Chen, Xinwei ;
Fan, Haoyi ;
Zeng, Kun ;
Li, Zuoyong .
APPLIED SOFT COMPUTING, 2021, 102
[9]   A Novel Transformer-Based Attention Network for Image Dehazing [J].
Gao, Guanlei ;
Cao, Jie ;
Bao, Chun ;
Hao, Qun ;
Ma, Aoqi ;
Li, Gang .
SENSORS, 2022, 22 (09)
[10]   Joint Raindrop and Haze Removal From a Single Image [J].
Guo, Yina ;
Chen, Jianguo ;
Ren, Xiaowen ;
Wang, Anhong ;
Wang, Wenwu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :9508-9519