Deep plug-and-play self-supervised neural networks for spectral snapshot compressive imaging

被引:0
|
作者
Zhang, Xing-Yu [1 ,3 ]
Zhu, Shou-Zheng [1 ,3 ]
Zhou, Tian-Shu [1 ,3 ]
Qi, Hong-Xing [1 ,3 ]
Wang, Jian-Yu [1 ,2 ,3 ]
Li, Chun-Lai [1 ,2 ,3 ]
Liu, Shi-Jie [1 ,3 ]
机构
[1] Univ Chinese Acad Sci, Hangzhou Inst Adv Study, Sch Phys & Optoeletron Engn, Hangzhou 310024, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Tech Phys, Key Lab Space Act Optoelect Technol, Shanghai 200083, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
compressed sensing; deep learning; self-supervised; coded aperture imaging;
D O I
10.11972/j.issn.1001-9014.2024.06.016
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The encoding aperture snapshot spectral imaging system, based on the compressive sensing theory, can be regarded as an encoder, which can efficiently obtain compressed two-dimensional spectral data and then decode it into three-dimensional spectral data through deep neural networks. However, training the deep neural networks requires a large amount of clean data that is difficult to obtain. To address the problem of insufficient training data for deep neural networks, a self-supervised hyperspectral denoising neural network based on neighborhood sampling is proposed. This network is integrated into a deep plug-and-play framework to achieve self-supervised spectral reconstruction. The study also examines the impact of different noise degradation models on the final reconstruction quality. Experimental results demonstrate that the self-supervised learning method enhances the average peak signal-to-noise ratio by 1. 18 dB and improves the structural similarity by 0. 009 compared with the supervised learning method. Additionally, it achieves better visual reconstruction results.
引用
收藏
页码:846 / 857
页数:12
相关论文
共 50 条
  • [31] Recent advances of deep learning for spectral snapshot compressive imaging
    Suo, Jinli
    Wu, Zongliang
    Li, Zhangyuan
    Yuan, Xin
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY IX, 2022, 12317
  • [32] Self-Supervised Dynamic CT Perfusion Image Denoising With Deep Neural Networks
    Wu, Dufan
    Ren, Hui
    Li, Quanzheng
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2021, 5 (03) : 350 - 361
  • [33] Contextual Classification Using Self-Supervised Auxiliary Models for Deep Neural Networks
    Palacio, Sebastian
    Engle, Philipp
    Hees, Joern
    Dengel, Andreas
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8937 - 8944
  • [34] PP-NAS: Searching for Plug-and-Play Blocks on Convolutional Neural Networks
    Xiao, Anqi
    Shen, Biluo
    Tian, Jie
    Hu, Zhenhua
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12718 - 12730
  • [35] Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network
    Chen, Yong
    Lai, Wenzhen
    He, Wei
    Zhao, Xi-Le
    Zeng, Jinshan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 926 - 941
  • [36] Enhanced deep unrolling networks for snapshot compressive hyperspectral imaging
    Qin, Xinran
    Quan, Yuhui
    Ji, Hui
    NEURAL NETWORKS, 2024, 174
  • [37] Self-Supervised Learning of a Deep Neural Network for Ultrafast Ultrasound Imaging as an Inverse Problem
    Zhang, Jingke
    He, Qiong
    Xiao, Yang
    Zheng, Hairong
    Wang, Congzhi
    Luo, Jianwen
    PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2020,
  • [38] Self-Supervised Neural Aggregation Networks for Human Parsing
    Zhao, Jian
    Li, Jianshu
    Nie, Xuecheng
    Zhao, Fang
    Chen, Yunpeng
    Wang, Zhecan
    Feng, Jiashi
    Yan, Shuicheng
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1595 - 1603
  • [39] SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networks
    Xu, Yan
    Huang, Zhaoyang
    Lin, Kwan-Yee
    Zhu, Xinge
    Shi, Jianping
    Bao, Hujun
    Zhang, Guofeng
    Li, Hongsheng
    CONFERENCE ON ROBOT LEARNING, VOL 155, 2020, 155 : 115 - 125
  • [40] Embedding Imputation With Self-Supervised Graph Neural Networks
    Varolgunes, Uras
    Yao, Shibo
    Ma, Yao
    Yu, Dantong
    IEEE ACCESS, 2023, 11 : 70610 - 70620