A Denoising Network Based on Frequency-Spectral- Spatial-Feature for Hyperspectral Image

被引:2
作者
Wang, Siqi [1 ,2 ]
Li, Liyuan [1 ,2 ]
Li, Xiaoyan [3 ]
Zhang, Jingwen [1 ,2 ]
Zhao, Lixing [4 ]
Su, Xiaofeng [5 ]
Chen, Fansheng [6 ,7 ]
机构
[1] Chinese Acad Sci, Shanghai Inst Tech Phys, Key Lab Intelligent Infrared Percept, Shanghai 200083, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Hangzhou 310024, Peoples R China
[4] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Hangzhou 310024, Peoples R China
[5] Chinese Acad Sci, Shanghai Inst Tech Phys, Shanghai 200083, Peoples R China
[6] Chinese Acad Sci, Shanghai Inst Tech Phys, Key Lab Intelligent Infrared Percept, Shanghai 200083, Peoples R China
[7] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Hangzhou 310024, Peoples R China
基金
美国国家科学基金会;
关键词
Frequency-spectral-spatial domain; hyper-spectral image denoising; octave network; spatial-spectral attention mechanism; LOW-RANK; SUPERRESOLUTION; RECONSTRUCTION; FUSION; CNN;
D O I
10.1109/JSTARS.2023.3285454
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The quality of hyperspectral images seriously impedes subsequent high-level vision tasks such as image segmentation, image encoding, and target detection. However, the frequency, spectral, and spatial properties of the hyperspectral noise pictures are not utilized fully by existing image denoising algorithms. To address this issue, a novel convolutional network based on united Octave and attention mechanism (UOANet) is proposed to extract the frequency-spectral-spatial-feature for denoising the actual noise of HSIs. In particular, the negative residual mapping embedded in Unet is proposed for multiscale abstract representation and two modules are designed for modeling global noisy HSI features in the frequency-spectral-spatial domain. First, with the use of residual Octave convolution module, our model can focus on the intrinsic properties of HSI noise distribution for desirable noise removal. Next, a parallel spatial-spectral attention module is used to fully utilize the rich spectrum data and the various spatial data of each band in HSI, which improves the richness of HSI details after denoising. Experimental results on both synthetic and real HSIs demonstrate the validity and superiority of UOANet compared with the state-of-the-arts under various noise settings.
引用
收藏
页码:6693 / 6710
页数:18
相关论文
共 57 条
  • [1] Multibranch Selective Kernel Networks for Hyperspectral Image Classification
    Alipour-Fard, T.
    Paoletti, M. E.
    Haut, Juan M.
    Arefi, H.
    Plaza, J.
    Plaza, A.
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (06) : 1089 - 1093
  • [2] Sparse Recovery of Hyperspectral Signal from Natural RGB Images
    Arad, Boaz
    Ben-Shahar, Ohad
    [J]. COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 19 - 34
  • [3] Bodrito T, 2021, ADV NEUR IN, V34
  • [4] Deep Spatial-Spectral Global Reasoning Network for Hyperspectral Image Denoising
    Cao, Xiangyong
    Fu, Xueyang
    Xu, Chen
    Meng, Deyu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network
    Chang, Yi
    Yan, Luxin
    Fang, Houzhang
    Zhong, Sheng
    Liao, Wenshan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (02): : 667 - 682
  • [6] Hyper-Laplacian Regularized Unidirectional Low-rank Tensor Recovery for Multispectral Image Denoising
    Chang, Yi
    Yan, Luxin
    Zhong, Sheng
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5901 - 5909
  • [7] Exploring Nonlocal Group Sparsity Under Transform Learning for Hyperspectral Image Denoising
    Chen, Yong
    He, Wei
    Zhao, Xi-Le
    Huang, Ting-Zhu
    Zeng, Jinshan
    Lin, Hui
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution
    Chen, Yunpeng
    Fan, Haoqi
    Xu, Bing
    Yan, Zhicheng
    Kalantidis, Yannis
    Rohrbach, Marcus
    Yan, Shuicheng
    Feng, Jiashi
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3434 - 3443
  • [9] Image denoising by sparse 3-D transform-domain collaborative filtering
    Dabov, Kostadin
    Foi, Alessandro
    Katkovnik, Vladimir
    Egiazarian, Karen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) : 2080 - 2095
  • [10] Deng CY, 2018, INT GEOSCI REMOTE SE, P4772, DOI 10.1109/IGARSS.2018.8519108