Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images

被引:101
|
作者
Lohit, Suhas [1 ]
Kulkarni, Kuldeep [2 ,3 ]
Kerviche, Ronan [4 ]
Turaga, Pavan [5 ]
Ashok, Amit [6 ]
机构
[1] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85281 USA
[2] Arizona State Univ, Dept Arts Media & Engn, Tempe, AZ 85281 USA
[3] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[4] Univ Arizona, Apple Inc, Coll Opt Sci, Tucson, AZ 85721 USA
[5] Arizona State Univ, Sch Arts Media & Engn, Tempe, AZ 85281 USA
[6] Univ Arizona, Coll Opt Sci, Tucson, AZ 85721 USA
关键词
Compressive sensing; convolutional neural network; generative adversarial network; SIGNAL RECONSTRUCTION; INVERSE PROBLEMS; RECOVERY; TRACKING;
D O I
10.1109/TCI.2018.2846413
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this paper, we propose a data-driven noniterative algorithm to overcome the shortcomings of earlier iterative algorithms. Our solution, ReconNet, is a deep neural network, which is learned end-to-end to map block-wise compressive measurements of the scene to the desired image blocks. Reconstruction of an image becomes a simple forward pass through the network and can be done in real time. We show empirically that our algorithm yields reconstructions with higher peak signal-to-noise ratios (PSNRs) compared to iterative algorithms at low measurement rates and in presence of measurement noise. We also propose a variant of ReconNet, which uses adversarial loss in order to further improve reconstruction quality. We discuss how adding a fully connected layer to the existing ReconNet architecture allows for jointly learning the measurement matrix and the reconstruction algorithm in a single network. Experiments on real data obtained from a block compressive imager show that our networks are robust to unseen sensor noise.
引用
收藏
页码:326 / 340
页数:15
相关论文
共 50 条
  • [41] Localization Convolutional Neural Networks Using Angle of Arrival Images
    Comiter, Marcus
    Kung, H. T.
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [42] Using convolutional neural networks for classification of malware represented as images
    Gibert, Daniel
    Mateu, Carles
    Planes, Jordi
    Vicens, Ramon
    JOURNAL OF COMPUTER VIROLOGY AND HACKING TECHNIQUES, 2019, 15 (01) : 15 - 28
  • [43] Detection of atmospheric emissions by classifying images with convolutional neural networks
    Perez-Chust, Ruben
    Fernandez-Moreno, Marta
    Garcia, Daniel F.
    2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1523 - 1527
  • [44] Recognition of gangues from color images using convolutional neural networks with attention mechanism
    Liu, Huajie
    Xu, Ke
    MEASUREMENT, 2023, 206
  • [45] Analysis of high-resolution reconstruction of medical images based on deep convolutional neural networks in lung cancer diagnostics
    Bai, Yang
    Li, Dan
    Duan, Qiongyu
    Chen, Xiaodong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 217
  • [46] Segmentation of Histopathological Images with Convolutional Neural Networks using Fourier Features
    Hatipolu, Nuh
    Bilgin, Gokhan
    2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 455 - 458
  • [47] Comparison of deep convolutional neural networks for classification of breast ultrasound images
    Park J.
    Kim Y.
    Ryu C.-W.
    Kim H.
    Transactions of the Korean Institute of Electrical Engineers, 2021, 70 (01) : 176 - 183
  • [48] Fingerprint Classification Using Convolutional Neural Networks and Ridge Orientation Images
    Shrein, John M.
    2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017, : 3242 - 3249
  • [49] Convolutional neural networks for Alzheimer's disease detection on MRI images
    Ebrahimi, Amir
    Luo, Suhuai
    JOURNAL OF MEDICAL IMAGING, 2021, 8 (02)
  • [50] Design of Convolutional Neural Networks for classification of ships from ISAR images
    Agarwal, Saraansh
    Sathish, Swetha
    Dyana, A.
    Nethravathi, K. A.
    2024 IEEE RADAR CONFERENCE, RADARCONF 2024, 2024,