Image reconstruction through dynamic scattering media based on deep learning

被引:118
作者
Sun, Yiwei [1 ]
Shi, Jianhong [1 ]
Sun, Lei [1 ]
Fan, Jianping [2 ]
Zeng, Guihua [1 ]
机构
[1] Shanghai Jiao Tong Univ, Ctr Quantum Sensing & Informat Proc, State Key Lab Adv Opt Commun Syst & Networks, Shanghai 200240, Peoples R China
[2] Univ N Carolina, Dept Comp Sci, Charlotte, NC 28223 USA
基金
中国国家自然科学基金;
关键词
OPTICAL-PHASE CONJUGATION; TIME;
D O I
10.1364/OE.27.016032
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Under complex scattering conditions; it is very difficult to capture clear object images hidden behind the media by modelling the inverse problem. With regard to dynamic scattering media; the challenge increases. For solving the inverse problem, we propose a new class-specific image reconstruction algorithm. The method based on deep learning classifies blurred scattering images according to scattering conditions and then recovers to clear images hidden behind the media. The deep learning network is used to learn the mapping relationship between the object and the scattering image rather than characterizing the scattering media explicitly or parametrically. 25000 scattering images are obtained under five sets of dynamic scattering condition to verity the feasibility of the proposed method. In addition, the generalizability of the method has been verified successfully. Compared with common CNN method, it's confirmed that our algorithm has better performance in reconstructing higher-quality images. Furthermore, for a given scattering image with unknown scattering condition, the closest scattering condition information can be given by classification network, and then the corresponding clear image is restored by reconstruction network. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:16032 / 16046
页数:15
相关论文
共 25 条
[1]   Speckle-learning-based object recognition through scattering media [J].
Ando, Takamasa ;
Horisaki, Ryoichi ;
Tanida, Jun .
OPTICS EXPRESS, 2015, 23 (26) :33902-33910
[2]   Non-invasive imaging through opaque scattering layers [J].
Bertolotti, Jacopo ;
van Putten, Elbert G. ;
Blum, Christian ;
Lagendijk, Ad ;
Vos, Willem L. ;
Mosk, Allard P. .
NATURE, 2012, 491 (7423) :232-234
[3]   High-speed scattering medium characterization with application to focusing light through turbid media [J].
Conkey, Donald B. ;
Caravaca-Aguirre, Antonio M. ;
Piestun, Rafael .
OPTICS EXPRESS, 2012, 20 (02) :1733-1740
[4]   Enhanced nonlinear imaging through scattering media using transmission-matrix-based wave-front shaping [J].
de Aguiar, Hilton B. ;
Gigan, Sylvain ;
Brasselet, Sophie .
PHYSICAL REVIEW A, 2016, 94 (04)
[5]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622
[6]   WAVEFRONT-RECONSTRUCTION IMAGING THROUGH RANDOM MEDIA - (RESOLUTION LIMITATIONS - ATMOSPHERIC EFFECTS - E/T) [J].
GOODMAN, JW ;
HUNTLEY, WH ;
JACKSON, DW ;
LEHMANN, M .
APPLIED PHYSICS LETTERS, 1966, 8 (12) :311-+
[7]  
Gorodnichev E. E., 1995, Journal of Experimental and Theoretical Physics, V80, P112
[8]   Digital optical phase conjugation for delivering two-dimensional images through turbid media [J].
Hillman, Timothy R. ;
Yamauchi, Toyohiko ;
Choi, Wonshik ;
Dasari, Ramachandra R. ;
Feld, Michael S. ;
Park, YongKeun ;
Yaqoob, Zahid .
SCIENTIFIC REPORTS, 2013, 3
[9]  
Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579
[10]   Learning-based focusing through scattering media [J].
Horisaki, Ryoichi ;
Takagi, Ryosuke ;
Tanida, Jun .
APPLIED OPTICS, 2017, 56 (15) :4358-4362