SMDS-Net: Model Guided Spectral-Spatial Network for Hyperspectral Image Denoising

被引:45
作者
Xiong, Fengchao [1 ,2 ,3 ]
Zhou, Jun [4 ]
Tao, Shuyin [1 ]
Lu, Jianfeng [1 ]
Zhou, Jiantao [5 ]
Qian, Yuntao [6 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Nanjing 210094, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[4] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
[5] Univ Macau, Dept Comp & Informat Sci, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[6] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Noise reduction; Noise measurement; Correlation; Neural networks; Training; Tensors; Sensors; Hyperspectral image denoising; model-based neural network; low-rank representation; multidimensional sparse representation; RESTORATION; REPRESENTATION; ALGORITHM; FILTER; CNN;
D O I
10.1109/TIP.2022.3196826
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning (DL) based hyperspectral images (HSIs) denoising approaches directly learn the nonlinear mapping between noisy and clean HSI pairs. They usually do not consider the physical characteristics of HSIs. This drawback makes the models lack interpretability that is key to understanding their denoising mechanism and limits their denoising ability. In this paper, we introduce a novel model-guided interpretable network for HSI denoising to tackle this problem. Fully considering the spatial redundancy, spectral low-rankness, and spectral-spatial correlations of HSIs, we first establish a subspace-based multidimensional sparse (SMDS) model under the umbrella of tensor notation. After that, the model is unfolded into an end-to-end network named SMDS-Net, whose fundamental modules are seamlessly connected with the denoising procedure and optimization of the SMDS model. This makes SMDS-Net convey clear physical meanings, i.e., learning the low-rankness and sparsity of HSIs. Finally, all key variables are obtained by discriminative training. Extensive experiments and comprehensive analysis on synthetic and real-world HSIs confirm the strong denoising ability, strong learning capability, promising generalization ability, and high interpretability of SMDS-Net against the state-of-the-art HSI denoising methods. The source code and data of this article will be made publicly available at https://github.com/bearshng/smds-net for reproducible research.
引用
收藏
页码:5469 / 5483
页数:15
相关论文
共 65 条
  • [1] Hyperspectral Recovery from RGB Images using Gaussian Processes
    Akhtar, Naveed
    Mian, Ajmal
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (01) : 100 - 113
  • [2] Hyperspectral Image Denoising via Clustering-Based Latent Variable in Variational Bayesian Framework
    Azimpour, Peyman
    Bahraini, Tahereh
    Yazdi, Hadi Sadoghi
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (04): : 3266 - 3276
  • [3] Hyperspectral subspace identification
    Bioucas-Dias, Jose M.
    Nascimento, Jose M. P.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (08): : 2435 - 2445
  • [4] Bodrito T., 2021, P ADV NEUR INF PROC, P1
  • [5] A non-local algorithm for image denoising
    Buades, A
    Coll, B
    Morel, JM
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, : 60 - 65
  • [6] PanCSC-Net: A Model-Driven Deep Unfolding Method for Pansharpening
    Cao, Xiangyong
    Fu, Xueyang
    Hong, Danfeng
    Xu, Zongben
    Meng, Deyu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Robust Low-Rank Matrix Factorization Under General Mixture Noise Distributions
    Cao, Xiangyong
    Zhao, Qian
    Meng, Deyu
    Chen, Yang
    Xu, Zongben
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (10) : 4677 - 4690
  • [8] Hyperspectral Image Restoration: Where Does the Low-Rank Property Exist
    Chang, Yi
    Yan, Luxin
    Chen, Bingling
    Zhong, Sheng
    Tian, Yonghong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (08): : 6869 - 6884
  • [9] HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network
    Chang, Yi
    Yan, Luxin
    Fang, Houzhang
    Zhong, Sheng
    Liao, Wenshan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (02): : 667 - 682
  • [10] Hyper-Laplacian Regularized Unidirectional Low-rank Tensor Recovery for Multispectral Image Denoising
    Chang, Yi
    Yan, Luxin
    Zhong, Sheng
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5901 - 5909