Deep plug-and-play self-supervised neural networks for spectral snapshot compressive imaging

被引:0
|
作者
Zhang, Xing-Yu [1 ,3 ]
Zhu, Shou-Zheng [1 ,3 ]
Zhou, Tian-Shu [1 ,3 ]
Qi, Hong-Xing [1 ,3 ]
Wang, Jian-Yu [1 ,2 ,3 ]
Li, Chun-Lai [1 ,2 ,3 ]
Liu, Shi-Jie [1 ,3 ]
机构
[1] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Sch Phys & Optoeletron Engn, Hangzhou 310024, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Tech Phys, Key Lab Space Act Optoelect Technol, Shanghai 200083, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
compressed sensing; deep learning; self-supervised; coded aperture imaging;
D O I
10.11972/j.issn.1001-9014.2024.06.016
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The encoding aperture snapshot spectral imaging system, based on the compressive sensing theory, can be regarded as an encoder, which can efficiently obtain compressed two-dimensional spectral data and then decode it into three-dimensional spectral data through deep neural networks. However, training the deep neural networks requires a large amount of clean data that is difficult to obtain. To address the problem of insufficient training data for deep neural networks, a self-supervised hyperspectral denoising neural network based on neighborhood sampling is proposed. This network is integrated into a deep plug-and-play framework to achieve self-supervised spectral reconstruction. The study also examines the impact of different noise degradation models on the final reconstruction quality. Experimental results demonstrate that the self-supervised learning method enhances the average peak signal-to-noise ratio by 1. 18 dB and improves the structural similarity by 0. 009 compared with the supervised learning method. Additionally, it achieves better visual reconstruction results.
引用
收藏
页码:846 / 857
页数:12
相关论文
共 50 条
  • [1] Self-supervised Neural Networks for Spectral Snapshot Compressive Imaging
    Meng, Ziyi
    Yu, Zhenming
    Xu, Kun
    Yuan, Xin
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2602 - 2611
  • [2] Deep plug-and-play priors for spectral snapshot compressive imaging
    SIMING ZHENG
    YANG LIU
    ZIYI MENG
    MU QIAO
    ZHISHEN TONG
    XIAOYU YANG
    SHENSHENG HAN
    XIN YUAN
    Photonics Research, 2021, 9 (02) : 18 - 29
  • [3] Deep plug-and-play priors for spectral snapshot compressive imaging
    Zheng, Siming
    Liu, Yang
    Meng, Ziyi
    Qiao, Mu
    Tong, Zhishen
    Yang, Xiaoyu
    Han, Shensheng
    Yuan, Xin
    PHOTONICS RESEARCH, 2021, 9 (02) : B18 - B29
  • [4] Plug-and-Play Algorithms for Video Snapshot Compressive Imaging
    Yuan, Xin
    Liu, Yang
    Suo, Jinli
    Durand, Fredo
    Dai, Qionghai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 7093 - 7111
  • [5] Combining Low-Rank and Deep Plug-and-Play Priors for Snapshot Compressive Imaging
    Chen, Yong
    Gui, Xinfeng
    Zeng, Jinshan
    Zhao, Xi-Le
    He, Wei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16396 - 16408
  • [6] Self-Supervised Deep Hyperspectral Inpainting with Plug-and-Play and Deep Image Prior Models
    Li, Shuo
    Yaghoobi, Mehrdad
    REMOTE SENSING, 2025, 17 (02)
  • [7] Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging
    Yuan, Xin
    Liu, Yang
    Suo, Jinli
    Dai, Qionghai
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1444 - 1454
  • [8] PERCEPTION INSPIRED DEEP NEURAL NETWORKS FOR SPECTRAL SNAPSHOT COMPRESSIVE IMAGING
    Meng, Ziyi
    Yuan, Xin
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2813 - 2817
  • [9] Low-Rank Tensor Optimization With Nonlocal Plug-and-Play Regularizers for Snapshot Compressive Imaging
    Li, Huan
    Zhao, Xi-Le
    Lin, Jie
    Chen, Yong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 581 - 593
  • [10] DEEP PLUG-AND-PLAY ALGORITHM FOR UNSATURATED IMAGING
    Bacca, Jorge
    Monroy, Brayan
    Arguello, Henry
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 2460 - 2464