DeepGhost: real-time computational ghost imaging via deep learning

被引:89
作者
Rizvi, Saad [1 ]
Cao, Jie [1 ]
Zhang, Kaiyu [1 ]
Hao, Qun [1 ]
机构
[1] Minist Educ, Beijing Inst Technol, Key Lab Biomimet Robots & Syst, Sch Opt & Photon, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
OBJECT AUTHENTICATION; SINGLE;
D O I
10.1038/s41598-020-68401-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The potential of random pattern based computational ghost imaging (CGI) for real-time applications has been offset by its long image reconstruction time and inefficient reconstruction of complex diverse scenes. To overcome these problems, we propose a fast image reconstruction framework for CGI, called "DeepGhost", using deep convolutional autoencoder network to achieve real-time imaging at very low sampling rates (10-20%). By transferring prior-knowledge from STL-10 dataset to physical-data driven network, the proposed framework can reconstruct complex unseen targets with high accuracy. The experimental results show that the proposed method outperforms existing deep learning and state-of-the-art compressed sensing methods used for ghost imaging under similar conditions. The proposed method employs deep architecture with fast computation, and tackles the shortcomings of existing schemes i.e., inappropriate architecture, training on limited data under controlled settings, and employing shallow network for fast computation.
引用
收藏
页数:9
相关论文
共 36 条
[1]  
[Anonymous], ficulty of training deep feedforward neural networks
[2]   On the use of deep learning for computational imaging [J].
Barbastathis, George ;
Ozcan, Aydogan ;
Situ, Guohai .
OPTICA, 2019, 6 (08) :921-943
[3]   Experimental comparison of single-pixel imaging algorithms [J].
Bian, Liheng ;
Suo, Jinli ;
Dai, Qionghai ;
Chen, Feng .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2018, 35 (01) :78-87
[4]   Ghost imaging with a single detector [J].
Bromberg, Yaron ;
Katz, Ori ;
Silberberg, Yaron .
PHYSICAL REVIEW A, 2009, 79 (05)
[5]   An introduction to compressive sampling: A sensing/sampling paradigm that goes against the common knowledge in data acquisition [J].
Candes, Emmanuel J. ;
Wakin, Michael B. .
IEEE Signal Processing Magazine, 2008, 25 (02) :21-30
[6]   Object authentication in computational ghost imaging with the realizations less than 5% of Nyquist limit [J].
Chen, Wen ;
Chen, Xudong .
OPTICS LETTERS, 2013, 38 (04) :546-548
[7]   Object authentication based on compressive ghost imaging [J].
Chen, Zhipeng ;
Shi, Jianhong ;
Zeng, Guihua .
APPLIED OPTICS, 2016, 55 (30) :8644-8650
[8]  
Coates A, 2011, AISTATS, V20, P20
[9]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[10]   Single-pixel imaging via compressive sampling [J].
Duarte, Marco F. ;
Davenport, Mark A. ;
Takhar, Dharmpal ;
Laska, Jason N. ;
Sun, Ting ;
Kelly, Kevin F. ;
Baraniuk, Richard G. .
IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (02) :83-91