Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images

被引:101
|
作者
Lohit, Suhas [1 ]
Kulkarni, Kuldeep [2 ,3 ]
Kerviche, Ronan [4 ]
Turaga, Pavan [5 ]
Ashok, Amit [6 ]
机构
[1] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85281 USA
[2] Arizona State Univ, Dept Arts Media & Engn, Tempe, AZ 85281 USA
[3] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[4] Univ Arizona, Apple Inc, Coll Opt Sci, Tucson, AZ 85721 USA
[5] Arizona State Univ, Sch Arts Media & Engn, Tempe, AZ 85281 USA
[6] Univ Arizona, Coll Opt Sci, Tucson, AZ 85721 USA
关键词
Compressive sensing; convolutional neural network; generative adversarial network; SIGNAL RECONSTRUCTION; INVERSE PROBLEMS; RECOVERY; TRACKING;
D O I
10.1109/TCI.2018.2846413
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this paper, we propose a data-driven noniterative algorithm to overcome the shortcomings of earlier iterative algorithms. Our solution, ReconNet, is a deep neural network, which is learned end-to-end to map block-wise compressive measurements of the scene to the desired image blocks. Reconstruction of an image becomes a simple forward pass through the network and can be done in real time. We show empirically that our algorithm yields reconstructions with higher peak signal-to-noise ratios (PSNRs) compared to iterative algorithms at low measurement rates and in presence of measurement noise. We also propose a variant of ReconNet, which uses adversarial loss in order to further improve reconstruction quality. We discuss how adding a fully connected layer to the existing ReconNet architecture allows for jointly learning the measurement matrix and the reconstruction algorithm in a single network. Experiments on real data obtained from a block compressive imager show that our networks are robust to unseen sensor noise.
引用
收藏
页码:326 / 340
页数:15
相关论文
共 50 条
  • [1] Joint modeling and reconstruction of a compressively-sensed set of correlated images
    Chang, Kan
    Li, Baoxin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 33 : 286 - 300
  • [2] An 81.92Gpixels/s Fast Reconstruction of Images from Compressively Sensed Measurements
    Xu, Jiayao
    Chi, Pham Do Kim
    Fu, Chen
    Zhou, Jinjia
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 2978 - 2982
  • [3] FORENSIC IDENTIFICATION OF COMPRESSIVELY SENSED IMAGES
    Chu, Xiaoyu
    Stamm, Matthew C.
    Lin, W. Sabrina
    Liu, K. J. Ray
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 1837 - 1840
  • [4] ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements
    Kulkarni, Kuldeep
    Lohit, Suhas
    Turaga, Pavan
    Kerviche, Ronan
    Ashok, Amit
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 449 - 458
  • [5] PATCH-BASED RESIDUAL NETWORKS FOR COMPRESSIVELY SENSED HYPERSPECTRAL IMAGES RESTRUCTION
    Hu, Xiaowei
    Xu, Yang
    Wei, Zhihui
    Liu, Hongyi
    Qian, Ling
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 6163 - 6166
  • [6] DeepCubeNet: reconstruction of spectrally compressive sensed hyperspectral images with deep neural networks
    Gedalin, Daniel
    Oiknine, Yaniv
    Stern, Adrian
    OPTICS EXPRESS, 2019, 27 (24) : 35811 - 35822
  • [7] Convolutional neural networks for the reconstruction of spectra in compressive sensing spectrometers
    Kim, Cheolsun
    Park, Dongju
    Lee, Heung-No
    OPTICAL DATA SCIENCE II, 2019, 10937
  • [8] CS-DeCNN: Deconvolutional Neural Network for Reconstructing Images from Compressively Sensed Measurements
    Wan, Wentao
    Li, Guohui
    Pan, Peng
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT I, 2018, 11164 : 71 - 80
  • [9] Interactive Image and Video Classification using Compressively Sensed Images
    Stubbs, Jaclynn J.
    Pattichis, Marios S.
    Birch, Gabriel C.
    2017 FIFTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2017, : 2038 - 2041
  • [10] Grayscale images colorization with convolutional neural networks
    Jiancheng An
    Koffi Gagnon Kpeyiton
    Qingnan Shi
    Soft Computing, 2020, 24 : 4751 - 4758