HDSA-Net: Haze Density and Semantic Awareness Network for Hyperspectral Image Dehazing

被引:0
作者
Liu, Qianru [1 ]
Song, Tiecheng [1 ]
Qin, Anyong [1 ]
Liu, Yin [1 ]
Yang, Feng [1 ]
Gao, Chenqiang [2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[2] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen Campus, Shenzhen 518107, Guangdong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Semantics; Remote sensing; Image restoration; Estimation; Feature extraction; Atmospheric modeling; Scattering; Learning systems; Earth; Deep learning; dehazing; haze removal; hyperspectral images; SAM; REFINEMENT NETWORK; REMOVAL;
D O I
10.1109/JSTARS.2024.3525072
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral image (HSI) dehazing is a challenging task due to the complex imaging conditions. Existing deep learning-based dehazing methods neither fully consider the physical characteristics of HSIs, nor take advantage of high-level semantic information to improve the dehazing performance. To remedy these, in this article we propose a Haze Density and Semantic Awareness Network (HDSA-Net) for HSI dehazing. Our dual-awareness network not only provides low-level physical information guidance but also high-level semantic guidance for haze removal. Specifically, we estimate the haze density by considering both internal spectral characteristics and external dehazing effects. Based on this, we build a Haze Density Awareness (HDA) block, which enables the network to perceive and focus on difficult dehazing regions with high density. Moreover, we design a Semantic information Extraction Block (SEB) based on the pretrained Segment Anything Model (SAM), followed by several Semantic information Perception Blocks (SPBs), to provide semantic guidance for HSI dehazing. In particular, SEB adapts SAM for the special HSI data and SPBs enable the network to progressively recover semantic information via channel-level coarse guidance and pixel-level fine guidance. The experimental results on simulated and real datasets show the superiority of HDSA-Net over state-of-the-art methods.
引用
收藏
页码:3989 / 4003
页数:15
相关论文
共 64 条
  • [1] Haze Removal for a Single Remote Sensing Image Using Low-Rank and Sparse Prior
    Bi, Guoling
    Si, Guoliang
    Zhao, Yuchen
    Qi, Biao
    Lv, Hengyi
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Make Segment Anything Model Perfect on Shadow Detection
    Chen, Xiao-Diao
    Wu, Wen
    Yang, Wenya
    Qin, Hongshuai
    Wu, Xiantao
    Mao, Xiaoyang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 13
  • [3] Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network
    Chen, Yong
    Lai, Wenzhen
    He, Wei
    Zhao, Xi-Le
    Zeng, Jinshan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 926 - 941
  • [4] DEA-Net: Single Image Dehazing Based on Detail-Enhanced Convolution and Content-Guided Attention
    Chen, Zixuan
    He, Zewei
    Lu, Zhe-Ming
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1002 - 1015
  • [5] Integrating Semantic Segmentation and Retinex Model for Low Light Image Enhancement
    Fan, Minhao
    Wang, Wenjing
    Yang, Wenhan
    Liu, Jiaying
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2317 - 2325
  • [6] Feng C, 2013, IEEE IMAGE PROC, P2363, DOI 10.1109/ICIP.2013.6738487
  • [7] Fu H, 2024, Arxiv, DOI arXiv:2406.05700
  • [8] A New Low-Rank Representation Based Hyperspectral Image Denoising Method for Mineral Mapping
    Gao, Lianru
    Yao, Dan
    Li, Qingting
    Zhuang, Lina
    Zhang, Bing
    Bioucas-Dias, Jose M.
    [J]. REMOTE SENSING, 2017, 9 (11):
  • [9] Frequency-Oriented Efficient Transformer for All-in-One Weather-Degraded Image Restoration
    Gao, Tao
    Wen, Yuanbo
    Zhang, Kaihao
    Zhang, Jing
    Chen, Ting
    Liu, Lidong
    Luo, Wenhan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1886 - 1899
  • [10] Unsupervised Single Image Dehazing Using Dark Channel Prior Loss
    Golts, Alona
    Freedman, Daniel
    Elad, Michael
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 2692 - 2701