SMDS-Net: Model Guided Spectral-Spatial Network for Hyperspectral Image Denoising

被引:45
|
作者
Xiong, Fengchao [1 ,2 ,3 ]
Zhou, Jun [4 ]
Tao, Shuyin [1 ]
Lu, Jianfeng [1 ]
Zhou, Jiantao [5 ]
Qian, Yuntao [6 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Nanjing 210094, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[4] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
[5] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[6] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Noise reduction; Noise measurement; Correlation; Neural networks; Training; Tensors; Sensors; Hyperspectral image denoising; model-based neural network; low-rank representation; multidimensional sparse representation; RESTORATION; REPRESENTATION; ALGORITHM; FILTER; CNN;
D O I
10.1109/TIP.2022.3196826
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning (DL) based hyperspectral images (HSIs) denoising approaches directly learn the nonlinear mapping between noisy and clean HSI pairs. They usually do not consider the physical characteristics of HSIs. This drawback makes the models lack interpretability that is key to understanding their denoising mechanism and limits their denoising ability. In this paper, we introduce a novel model-guided interpretable network for HSI denoising to tackle this problem. Fully considering the spatial redundancy, spectral low-rankness, and spectral-spatial correlations of HSIs, we first establish a subspace-based multidimensional sparse (SMDS) model under the umbrella of tensor notation. After that, the model is unfolded into an end-to-end network named SMDS-Net, whose fundamental modules are seamlessly connected with the denoising procedure and optimization of the SMDS model. This makes SMDS-Net convey clear physical meanings, i.e., learning the low-rankness and sparsity of HSIs. Finally, all key variables are obtained by discriminative training. Extensive experiments and comprehensive analysis on synthetic and real-world HSIs confirm the strong denoising ability, strong learning capability, promising generalization ability, and high interpretability of SMDS-Net against the state-of-the-art HSI denoising methods. The source code and data of this article will be made publicly available at https://github.com/bearshng/smds-net for reproducible research.
引用
收藏
页码:5469 / 5483
页数:15
相关论文
共 50 条
  • [1] Spectral-Spatial Kernel Regularized for Hyperspectral Image Denoising
    Yuan, Yuan
    Zheng, Xiangtao
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (07): : 3815 - 3832
  • [2] Hyperspectral Image Denoising Employing a Spectral-Spatial Adaptive Total Variation Model
    Yuan, Qiangqiang
    Zhang, Liangpei
    Shen, Huanfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (10): : 3660 - 3677
  • [3] Spectral-Spatial Adaptive Sparse Representation for Hyperspectral Image Denoising
    Lu, Ting
    Li, Shutao
    Fang, Leyuan
    Ma, Yi
    Benediktsson, Jon Atli
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (01): : 373 - 385
  • [4] Efficient convolutional neural network for spectral-spatial hyperspectral denoising
    Maffei, Alessandro
    Haut, Juan M.
    Paoletti, Mercedes E.
    Plaza, Javier
    Bruzone, Lorenzo
    Plaza, Antonio
    2019 10TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING - EVOLUTION IN REMOTE SENSING (WHISPERS), 2019,
  • [5] Spectral-Spatial Attention Network for Hyperspectral Image Classification
    Sun, Hao
    Zheng, Xiangtao
    Lu, Xiaoqiang
    Wu, Siyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3232 - 3245
  • [6] HYPERSPECTRAL IMAGE DENOISING VIA COUPLED SPECTRAL-SPATIAL TENSOR REPRESENTATION
    Zhao, Lu
    Xu, Yang
    Wei, Zhihui
    Yu, Renping
    Qian, Ling
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 4784 - 4787
  • [7] Bilayer Elastic Net Regression Model for Supervised Spectral-Spatial Hyperspectral Image Classification
    Soomro, Bushra Naz
    Xiao, Liang
    Huang, Lili
    Soomro, Shahzad Hyder
    Molaei, Mohsen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2016, 9 (09) : 4102 - 4116
  • [8] MS2A-Net: Multiscale Spectral-Spatial Association Network for Hyperspectral Image Clustering
    Shahi, Kasra Rafiezadeh
    Ghamisi, Pedram
    Rasti, Behnood
    Gloaguen, Richard
    Scheunders, Paul
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 6518 - 6530
  • [9] Dilated Spectral-Spatial Gaussian Transformer Net for Hyperspectral Image Classification
    Zhang, Zhenbei
    Wang, Shuo
    Zhang, Weilin
    REMOTE SENSING, 2024, 16 (02)
  • [10] Spectral-spatial attention bilateral network for hyperspectral image classification
    Yang X.
    Chi Y.
    Zhou Y.
    Wang Y.
    National Remote Sensing Bulletin, 2023, 27 (11) : 2565 - 2578