Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images

被引:101
|
作者
Lohit, Suhas [1 ]
Kulkarni, Kuldeep [2 ,3 ]
Kerviche, Ronan [4 ]
Turaga, Pavan [5 ]
Ashok, Amit [6 ]
机构
[1] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85281 USA
[2] Arizona State Univ, Dept Arts Media & Engn, Tempe, AZ 85281 USA
[3] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[4] Univ Arizona, Apple Inc, Coll Opt Sci, Tucson, AZ 85721 USA
[5] Arizona State Univ, Sch Arts Media & Engn, Tempe, AZ 85281 USA
[6] Univ Arizona, Coll Opt Sci, Tucson, AZ 85721 USA
关键词
Compressive sensing; convolutional neural network; generative adversarial network; SIGNAL RECONSTRUCTION; INVERSE PROBLEMS; RECOVERY; TRACKING;
D O I
10.1109/TCI.2018.2846413
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this paper, we propose a data-driven noniterative algorithm to overcome the shortcomings of earlier iterative algorithms. Our solution, ReconNet, is a deep neural network, which is learned end-to-end to map block-wise compressive measurements of the scene to the desired image blocks. Reconstruction of an image becomes a simple forward pass through the network and can be done in real time. We show empirically that our algorithm yields reconstructions with higher peak signal-to-noise ratios (PSNRs) compared to iterative algorithms at low measurement rates and in presence of measurement noise. We also propose a variant of ReconNet, which uses adversarial loss in order to further improve reconstruction quality. We discuss how adding a fully connected layer to the existing ReconNet architecture allows for jointly learning the measurement matrix and the reconstruction algorithm in a single network. Experiments on real data obtained from a block compressive imager show that our networks are robust to unseen sensor noise.
引用
收藏
页码:326 / 340
页数:15
相关论文
共 50 条
  • [21] Restoration of Historical Document Images Convolutional Neural Networks
    Raha, Poulami
    Chanda, Bhabatosh
    PROCEEDINGS OF 2019 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2019, : 56 - 61
  • [22] Low-Complexity On-Demand Reconstruction for Compressively Sensed Problematic Signals
    Chou, Ching-Yao
    Hsu, Kai-Chieh
    Cho, Bo-Hong
    Chen, Kuan-Chun
    Wu, An-Yeu Andy
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 4094 - 4107
  • [23] Filtering of Gaussian filter based embedded enhancement technique for compressively sensed images
    Suganesh, V.
    Poovathy, J. Florence Gnana
    Radha, S.
    PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, SIGNAL PROCESSING AND NETWORKING (WISPNET), 2016, : 2177 - 2181
  • [24] Detection of epileptic seizures from compressively sensed EEG signals for wireless body area networks
    Aghababaei, Mohammad H.
    Azemi, Ghasem
    O'Toole, John M.
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 172
  • [25] APMC: Adjacent Pixels Based Measurement Coding System for Compressively Sensed Images
    Wan, Rentao
    Zhou, Jinjia
    Huang, Bowen
    Zeng, Hui
    Fan, Yibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3558 - 3569
  • [26] Optimization Methods of Compressively Sensed Image Reconstruction Based on Single-Pixel Imaging
    Wei, Ziran
    Zhang, Jianlin
    Xu, Zhiyong
    Liu, Yong
    APPLIED SCIENCES-BASEL, 2020, 10 (09):
  • [27] A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction
    Schlemper, Jo
    Caballero, Jose
    Hajnal, Joseph V.
    Price, Anthony
    Rueckert, Daniel
    INFORMATION PROCESSING IN MEDICAL IMAGING (IPMI 2017), 2017, 10265 : 647 - 658
  • [28] Automatic segmentation of medical images using convolutional neural networks
    Mesbahi, Sourour
    Yazid, Hedi
    2020 5TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP'2020), 2020,
  • [29] Convolutional Neural Networks for Page Segmentation of Historical Document Images
    Chen, Kai
    Seuret, Mathias
    Henneberet, Jean
    Ingold, Rolf
    2017 14TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), VOL 1, 2017, : 965 - 970
  • [30] Building an Ensemble of Convolutional Neural Networks for Classifying Panoramic Images
    P. O. Arkhipov
    S. L. Philippskih
    Pattern Recognition and Image Analysis, 2022, 32 : 511 - 514