Deep plug-and-play self-supervised neural networks for spectral snapshot compressive imaging

被引:0
|
作者
Zhang, Xing-Yu [1 ,3 ]
Zhu, Shou-Zheng [1 ,3 ]
Zhou, Tian-Shu [1 ,3 ]
Qi, Hong-Xing [1 ,3 ]
Wang, Jian-Yu [1 ,2 ,3 ]
Li, Chun-Lai [1 ,2 ,3 ]
Liu, Shi-Jie [1 ,3 ]
机构
[1] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Sch Phys & Optoeletron Engn, Hangzhou 310024, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Tech Phys, Key Lab Space Act Optoelect Technol, Shanghai 200083, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
compressed sensing; deep learning; self-supervised; coded aperture imaging;
D O I
10.11972/j.issn.1001-9014.2024.06.016
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The encoding aperture snapshot spectral imaging system, based on the compressive sensing theory, can be regarded as an encoder, which can efficiently obtain compressed two-dimensional spectral data and then decode it into three-dimensional spectral data through deep neural networks. However, training the deep neural networks requires a large amount of clean data that is difficult to obtain. To address the problem of insufficient training data for deep neural networks, a self-supervised hyperspectral denoising neural network based on neighborhood sampling is proposed. This network is integrated into a deep plug-and-play framework to achieve self-supervised spectral reconstruction. The study also examines the impact of different noise degradation models on the final reconstruction quality. Experimental results demonstrate that the self-supervised learning method enhances the average peak signal-to-noise ratio by 1. 18 dB and improves the structural similarity by 0. 009 compared with the supervised learning method. Additionally, it achieves better visual reconstruction results.
引用
收藏
页码:846 / 857
页数:12
相关论文
共 50 条
  • [21] Recurrent Neural Networks for Snapshot Compressive Imaging
    Cheng, Ziheng
    Chen, Bo
    Lu, Ruiying
    Wang, Zhengjue
    Zhang, Hao
    Meng, Ziyi
    Yuan, Xin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2264 - 2281
  • [22] Review on self-supervised image recognition using deep neural networks
    Ohri, Kriti
    Kumar, Mukesh
    KNOWLEDGE-BASED SYSTEMS, 2021, 224
  • [23] Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
    Jing, Longlong
    Tian, Yingli
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) : 4037 - 4058
  • [24] Plug and Play Deep Convolutional Neural Networks
    Neary, Patrick
    Allan, Vicki
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 388 - 395
  • [25] Self-Supervised Deep Multiview Spectral Clustering
    Zong, Linlin
    Miao, Faqiang
    Zhang, Xianchao
    Liang, Wenxin
    Xu, Bo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 4299 - 4308
  • [26] HIGH-QUALITY SELF-SUPERVISED SNAPSHOT HYPERSPECTRAL IMAGING
    Quan, Yuhui
    Qin, Xinran
    Chen, Mingqin
    Huang, Yan
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1526 - 1530
  • [27] Electromagnetic Inversion Regularized by a Plug-and-Play Deep Neural Network Denoiser
    Gao, Lingqi
    Bagci, Hakan
    2024 IEEE INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION AND INC/USNCURSI RADIO SCIENCE MEETING, AP-S/INC-USNC-URSI 2024, 2024, : 161 - 162
  • [28] Deep Unfolding-Aided Parameter Tuning for Plug-and-Play-Based Video Snapshot Compressive Imaging
    Matsuda, Takashi
    Hayakawa, Ryo
    Iiguni, Youji
    IEEE ACCESS, 2025, 13 : 24867 - 24879
  • [29] Dual-Domain Self-supervised Learning and Model Adaption for Deep Compressive Imaging
    Quan, Yuhui
    Qin, Xinran
    Pang, Tongyao
    Ji, Hui
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 409 - 426
  • [30] Self-supervised hamiltonian mechanics neural networks
    Zhan, Youqiu
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 271 - 275