Deep plug-and-play self-supervised neural networks for spectral snapshot compressive imaging

被引:0
|
作者
Zhang, Xing-Yu [1 ,3 ]
Zhu, Shou-Zheng [1 ,3 ]
Zhou, Tian-Shu [1 ,3 ]
Qi, Hong-Xing [1 ,3 ]
Wang, Jian-Yu [1 ,2 ,3 ]
Li, Chun-Lai [1 ,2 ,3 ]
Liu, Shi-Jie [1 ,3 ]
机构
[1] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Sch Phys & Optoeletron Engn, Hangzhou 310024, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Tech Phys, Key Lab Space Act Optoelect Technol, Shanghai 200083, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
compressed sensing; deep learning; self-supervised; coded aperture imaging;
D O I
10.11972/j.issn.1001-9014.2024.06.016
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The encoding aperture snapshot spectral imaging system, based on the compressive sensing theory, can be regarded as an encoder, which can efficiently obtain compressed two-dimensional spectral data and then decode it into three-dimensional spectral data through deep neural networks. However, training the deep neural networks requires a large amount of clean data that is difficult to obtain. To address the problem of insufficient training data for deep neural networks, a self-supervised hyperspectral denoising neural network based on neighborhood sampling is proposed. This network is integrated into a deep plug-and-play framework to achieve self-supervised spectral reconstruction. The study also examines the impact of different noise degradation models on the final reconstruction quality. Experimental results demonstrate that the self-supervised learning method enhances the average peak signal-to-noise ratio by 1. 18 dB and improves the structural similarity by 0. 009 compared with the supervised learning method. Additionally, it achieves better visual reconstruction results.
引用
收藏
页码:846 / 857
页数:12
相关论文
共 50 条
  • [41] Self-Supervised Contrastive Learning In Spiking Neural Networks
    Bahariasl, Yeganeh
    Kheradpisheh, Saeed Reza
    PROCEEDINGS OF THE 13TH IRANIAN/3RD INTERNATIONAL MACHINE VISION AND IMAGE PROCESSING CONFERENCE, MVIP, 2024, : 181 - 185
  • [42] Deep-Learning Supervised Snapshot Compressive Imaging Enabled by an End-to-End Adaptive Neural Network
    Marquez, Miguel
    Lai, Yingming
    Liu, Xianglei
    Jiang, Cheng
    Zhang, Shian
    Arguello, Henry
    Liang, Jinyang
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (04) : 688 - 699
  • [43] Self-supervised role learning for graph neural networks
    Sankar, Aravind
    Wang, Junting
    Krishnan, Adit
    Sundaram, Hari
    KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (08) : 2091 - 2121
  • [45] Self-supervised role learning for graph neural networks
    Aravind Sankar
    Junting Wang
    Adit Krishnan
    Hari Sundaram
    Knowledge and Information Systems, 2022, 64 : 2091 - 2121
  • [46] PP-MPI: A Deep Plug-and-Play Prior for Magnetic Particle Imaging Reconstruction
    Askin, Baris
    Güngör, Alper
    Soydan, Damla Alptekin
    Saritas, Emine Ulku
    Top, Can Baris
    Cukur, Tolga
    MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION (MLMIR 2022), 2022, 13587 : 105 - 114
  • [47] Deep neural networks for compressive hyperspectral imaging
    Lee, Dennis J.
    IMAGING SPECTROMETRY XXIII: APPLICATIONS, SENSORS, AND PROCESSING, 2019, 11130
  • [48] Hierarchical plug-and-play self-diagnosable intelligent sensor networks for process control
    Joshi, Bharat
    Vincent, Tyrone
    Chen, Jinran
    Somani, Arun
    Gomez, Nicholas
    Mitra, Reshmi
    2008 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY, 2008, : 246 - +
  • [49] Visual-Guided Robot Arm Using Self-Supervised Deep Convolutional Neural Networks
    Van-Thanh Nguyen
    Lin, Chao
    Li, Chih-Hung G.
    Guo, Shu-Mei
    Lien, Jenn-Jier James
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2019, : 1415 - 1420
  • [50] Self-supervised learning of materials concepts from crystal structures via deep neural networks
    Suzuki, Yuta
    Taniai, Tatsunori
    Saito, Kotaro
    Ushiku, Yoshitaka
    Ono, Kanta
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (04):