Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images

被引:101
|
作者
Lohit, Suhas [1 ]
Kulkarni, Kuldeep [2 ,3 ]
Kerviche, Ronan [4 ]
Turaga, Pavan [5 ]
Ashok, Amit [6 ]
机构
[1] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85281 USA
[2] Arizona State Univ, Dept Arts Media & Engn, Tempe, AZ 85281 USA
[3] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[4] Univ Arizona, Apple Inc, Coll Opt Sci, Tucson, AZ 85721 USA
[5] Arizona State Univ, Sch Arts Media & Engn, Tempe, AZ 85281 USA
[6] Univ Arizona, Coll Opt Sci, Tucson, AZ 85721 USA
关键词
Compressive sensing; convolutional neural network; generative adversarial network; SIGNAL RECONSTRUCTION; INVERSE PROBLEMS; RECOVERY; TRACKING;
D O I
10.1109/TCI.2018.2846413
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this paper, we propose a data-driven noniterative algorithm to overcome the shortcomings of earlier iterative algorithms. Our solution, ReconNet, is a deep neural network, which is learned end-to-end to map block-wise compressive measurements of the scene to the desired image blocks. Reconstruction of an image becomes a simple forward pass through the network and can be done in real time. We show empirically that our algorithm yields reconstructions with higher peak signal-to-noise ratios (PSNRs) compared to iterative algorithms at low measurement rates and in presence of measurement noise. We also propose a variant of ReconNet, which uses adversarial loss in order to further improve reconstruction quality. We discuss how adding a fully connected layer to the existing ReconNet architecture allows for jointly learning the measurement matrix and the reconstruction algorithm in a single network. Experiments on real data obtained from a block compressive imager show that our networks are robust to unseen sensor noise.
引用
收藏
页码:326 / 340
页数:15
相关论文
共 50 条
  • [31] Thyroid Nodule Detection in Ultrasound Images with Convolutional Neural Networks
    Xie, Shuaining
    Yu, Jing
    Liu, Tianjiao
    Chang, Qing
    Niu, Lijuan
    Sun, Weidong
    PROCEEDINGS OF THE 2019 14TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2019), 2019, : 1442 - 1446
  • [32] Measurement Matrix Optimization via Mutual Coherence Minimization for Compressively Sensed Signals Reconstruction
    Wei, Ziran
    Zhang, Jianlin
    Xu, Zhiyong
    Liu, Yong
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [33] Radio Frequency Tomographic Reconstruction Based on Convolutional Neural Networks
    Li, Jia
    Ewing, Robert L.
    Shen, Xiaoping
    NAECON 2018 - IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE, 2018, : 578 - 582
  • [34] Grading of Brain Histopathology Images via Convolutional Neural Networks
    Yurttakal, Ahmet Hasim
    Erbay, Hasan
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [35] Building an Ensemble of Convolutional Neural Networks for Classifying Panoramic Images
    Arkhipov, P. O.
    Philippskih, S. L.
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2022, 32 (03) : 511 - 514
  • [36] Compressively Sensed Ultrasound Radio-frequency Data Reconstruction Using the Combined Curvelets and Wave Atoms Basis
    Hussain, Mohammad Arafat
    Shourov, Riad Mashrub
    2015 INTERNATIONAL CONFERENCE ON ELECTRICAL & ELECTRONIC ENGINEERING (ICEEE), 2015, : 209 - 212
  • [37] Measuring CT Reconstruction Quality with Deep Convolutional Neural Networks
    Patwari, Mayank
    Gutjahr, Ralf
    Raupach, Rainer
    Maier, Andreas
    MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION, MLMIR 2019, 2019, 11905 : 113 - 124
  • [38] Compressively Sensed Multi-View Image Reconstruction Using Joint Optimization Modeling
    Zhu, Jiale
    Wang, Jin
    Zhu, Qing
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [39] Using convolutional neural networks for classification of malware represented as images
    Daniel Gibert
    Carles Mateu
    Jordi Planes
    Ramon Vicens
    Journal of Computer Virology and Hacking Techniques, 2019, 15 : 15 - 28
  • [40] Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction
    Qin, Chen
    Schlemper, Jo
    Caballero, Jose
    Price, Anthony N.
    Hajnal, Joseph V.
    Rueckert, Daniel
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (01) : 280 - 290