HDSA-Net: Haze Density and Semantic Awareness Network for Hyperspectral Image Dehazing

被引:0
作者
Liu, Qianru [1 ]
Song, Tiecheng [1 ]
Qin, Anyong [1 ]
Liu, Yin [1 ]
Yang, Feng [1 ]
Gao, Chenqiang [2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[2] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen Campus, Shenzhen 518107, Guangdong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Semantics; Remote sensing; Image restoration; Estimation; Feature extraction; Atmospheric modeling; Scattering; Learning systems; Earth; Deep learning; dehazing; haze removal; hyperspectral images; SAM; REFINEMENT NETWORK; REMOVAL;
D O I
10.1109/JSTARS.2024.3525072
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral image (HSI) dehazing is a challenging task due to the complex imaging conditions. Existing deep learning-based dehazing methods neither fully consider the physical characteristics of HSIs, nor take advantage of high-level semantic information to improve the dehazing performance. To remedy these, in this article we propose a Haze Density and Semantic Awareness Network (HDSA-Net) for HSI dehazing. Our dual-awareness network not only provides low-level physical information guidance but also high-level semantic guidance for haze removal. Specifically, we estimate the haze density by considering both internal spectral characteristics and external dehazing effects. Based on this, we build a Haze Density Awareness (HDA) block, which enables the network to perceive and focus on difficult dehazing regions with high density. Moreover, we design a Semantic information Extraction Block (SEB) based on the pretrained Segment Anything Model (SAM), followed by several Semantic information Perception Blocks (SPBs), to provide semantic guidance for HSI dehazing. In particular, SEB adapts SAM for the special HSI data and SPBs enable the network to progressively recover semantic information via channel-level coarse guidance and pixel-level fine guidance. The experimental results on simulated and real datasets show the superiority of HDSA-Net over state-of-the-art methods.
引用
收藏
页码:3989 / 4003
页数:15
相关论文
共 64 条
  • [11] Gui J, 2021, PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, P4426
  • [12] Landsat-8 OLI Multispectral Image Dehazing Based on Optimized Atmospheric Scattering Model
    Guo, Jianhua
    Yang, Jingyu
    Yue, Huanjing
    Hou, Chunping
    Li, Kun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (12): : 10255 - 10265
  • [13] RSDehazeNet: Dehazing Network With Channel Refinement for Multispectral Remote Sensing Images
    Guo, Jianhua
    Yang, Jingyu
    Yue, Huanjing
    Tan, Hai
    Hou, Chunping
    Li, Kun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (03): : 2535 - 2549
  • [14] Cloud-Based Analysis of Large-Scale Hyperspectral Imagery for Oil Spill Detection
    Haut, Juan M.
    Moreno-Alvarez, Sergio
    Pastor-Vargas, Rafael
    Perez-Garcia, Ambar
    Paoletti, Mercedes E.
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 2461 - 2474
  • [15] An Unsupervised Dehazing Network With Hybrid Prior Constraints for Hyperspectral Image
    He, Wei
    Wang, Mengyuan
    Chen, Yong
    Zhang, Hongyan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [16] SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers
    Hong, Danfeng
    Han, Zhu
    Yao, Jing
    Gao, Lianru
    Zhang, Bing
    Plaza, Antonio
    Chanussot, Jocelyn
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [17] Guided-Pix2Pix: End-to-End Inference and Refinement Network for Image Dehazing
    Jiao, Libin
    Hu, Changmiao
    Huo, Lianzhi
    Tang, Ping
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 3052 - 3069
  • [18] IDGCP: Image Dehazing Based on Gamma Correction Prior
    Ju, Mingye
    Ding, Can
    Guo, Y. Jay
    Zhang, Dengyin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 3104 - 3118
  • [19] Self-Supervised SpectralSpatial Transformer Network for Hyperspectral Oil Spill Mapping
    Kang, Xudong
    Deng, Bin
    Duan, Puhong
    Wei, Xiaohui
    Li, Shutao
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [20] The Potential of Hyperspectral Image Classification for Oil Spill Mapping
    Kang, Xudong
    Wang, Zihao
    Duan, Puhong
    Wei, Xiaohui
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60