Convolutional Neural Networks for Noniterative Reconstruction of Compressively Sensed Images

被引:108
作者
Lohit, Suhas [1 ]
Kulkarni, Kuldeep [2 ,3 ]
Kerviche, Ronan [4 ]
Turaga, Pavan [5 ]
Ashok, Amit [6 ]
机构
[1] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85281 USA
[2] Arizona State Univ, Dept Arts Media & Engn, Tempe, AZ 85281 USA
[3] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[4] Univ Arizona, Apple Inc, Coll Opt Sci, Tucson, AZ 85721 USA
[5] Arizona State Univ, Sch Arts Media & Engn, Tempe, AZ 85281 USA
[6] Univ Arizona, Coll Opt Sci, Tucson, AZ 85721 USA
关键词
Compressive sensing; convolutional neural network; generative adversarial network; SIGNAL RECONSTRUCTION; INVERSE PROBLEMS; RECOVERY; TRACKING;
D O I
10.1109/TCI.2018.2846413
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this paper, we propose a data-driven noniterative algorithm to overcome the shortcomings of earlier iterative algorithms. Our solution, ReconNet, is a deep neural network, which is learned end-to-end to map block-wise compressive measurements of the scene to the desired image blocks. Reconstruction of an image becomes a simple forward pass through the network and can be done in real time. We show empirically that our algorithm yields reconstructions with higher peak signal-to-noise ratios (PSNRs) compared to iterative algorithms at low measurement rates and in presence of measurement noise. We also propose a variant of ReconNet, which uses adversarial loss in order to further improve reconstruction quality. We discuss how adding a fully connected layer to the existing ReconNet architecture allows for jointly learning the measurement matrix and the reconstruction algorithm in a single network. Experiments on real data obtained from a block compressive imager show that our networks are robust to unseen sensor noise.
引用
收藏
页码:326 / 340
页数:15
相关论文
共 57 条
[21]   Deep Colorization [J].
Cheng, Zezhou ;
Yang, Qingxiong ;
Sheng, Bin .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :415-423
[22]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[23]  
Dave A, 2017, IEEE IMAGE PROC, P1702, DOI 10.1109/ICIP.2017.8296572
[24]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[25]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[26]   Compressive Sensing via Nonlocal Low-Rank Regularization [J].
Dong, Weisheng ;
Shi, Guangming ;
Li, Xin ;
Ma, Yi ;
Huang, Feng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (08) :3618-3632
[27]   Message-passing algorithms for compressed sensing [J].
Donoho, David L. ;
Maleki, Arian ;
Montanari, Andrea .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2009, 106 (45) :18914-18919
[28]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[29]   Wavelet-domain compressive signal reconstruction using a Hidden Markov Tree model [J].
Duarte, Marco F. ;
Wakin, Michael B. ;
Baraniuk, Richard G. .
2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, :5137-+
[30]  
Eigen D, 2014, ADV NEUR IN, V27