Scattering imaging with deep learning: Physical and data joint modeling optimization (invited)

被引:0
作者
Guo E. [1 ]
Shi Y. [1 ]
Zhu S. [1 ]
Cheng Q. [1 ]
Wei Y. [1 ]
Miao J. [1 ]
Han J. [1 ]
机构
[1] Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense Laboratory, Nanjing University of Science and Technology, Nanjing
来源
Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering | 2022年 / 51卷 / 08期
关键词
computational imaging; deep learning; neural network; scattering imaging;
D O I
10.3788/IRLA20220563
中图分类号
学科分类号
摘要
More scattering imaging methods have been proposed to realize imaging using scattered optical signals. Deep learning plays an important role in the field of imaging through scattering medium with its powerful data representation ability and information extraction ability. Compared with traditional scattering imaging methods, deep learning-based scattering imaging methods have great advantages in imaging speed, imaging quality, information dimension, and other aspects. However, the problems of model training, model generalization also restrict the development of this method. Therefore, more and more studies jointly model physical processes with data-driven-based methods and use physical priors to guide neural network optimization. Compared with the simple data-driven method, the physical-data joint modeling method greatly reduces the dependence on the amount of data and the number of neural network parameters, which can effectively reduce the difficulty of data acquisition and the requirements for experimental environment under the premise of ensuring the imaging quality. The joint modeling optimization method realizes the generalization of the medium and the type of hidden targets. At the same time, the training strategy of those methods is also being optimized which is realized from the supervised to semi-supervised and then to unsupervised. The proposed different models and supervision strategies greatly improve training efficiency. Those advantages improve the method of imaging through scattering medium based on the deep learning scenario application possibility out of the laboratory while reducing the cost of hardware and time. © 2022 Chinese Society of Astronautics. All rights reserved.
引用
收藏
相关论文
共 60 条
[1]  
Zhan X, Gao J, Gan Y, Et al., Roles of scattered and ballistic photons in imaging through scattering media: A deep learning-based study [J], (2022)
[2]  
Popoff S M, Lerosey G, Carminati R, Et al., Measuring the transmission matrix in optics: An approach to the study and control of light propagation in disordered media, Physical Review Letters, 104, 10, (2010)
[3]  
Li Y, Xue Y, Tian L., Deep speckle correlation: A deep learning approach toward scalable imaging through scattering media, Optica, 5, 10, pp. 1181-1190, (2018)
[4]  
Matthes M W, Bromberg Y, de Rosny J, Et al., Learning and avoiding disorder in multimode fibers, Physical Review X, 11, 2, (2021)
[5]  
d'Arco A, Xia F, Boniface A, Et al., Physics-based neural network for non-invasive control of coherent light in scattering media, Optics Express, 30, 17, pp. 30845-30856, (2022)
[6]  
Zhu S, Guo E, Gu J, Et al., Imaging through unknown scattering media based on physics-informed learning, Photonics Research, 9, 5, pp. B210-B219, (2021)
[7]  
Zhu S, Guo E, Gu J, Et al., Efficient color imaging through unknown opaque scattering layers via physics-aware learning, Optics Express, 29, 24, pp. 40024-40037, (2021)
[8]  
Liao M, Zheng S, Pan S, Et al., Deep-learning-based ciphertextonly attack on optical double random phase encryption, OptoElectronic Advances, 4, 5, (2021)
[9]  
Katz O, Heidmann P, Fink M, Et al., Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations, Nature Photonics, 8, 10, pp. 784-790, (2014)
[10]  
Freund I, Rosenbluh M, Feng S., Memory effects in propagation of optical waves through disordered media, Physical Review Letters, 61, 20, pp. 2328-2331, (1988)