Phase imaging with an untrained neural network

被引:0
作者
Fei Wang
Yaoming Bian
Haichao Wang
Meng Lyu
Giancarlo Pedrini
Wolfgang Osten
George Barbastathis
Guohai Situ
机构
[1] Chinese Academy of Sciences,Shanghai Institute of Optics and Fine Mechanics
[2] University of Chinese Academy of Sciences,Center of Materials Science and Optoelectronics Engineering
[3] Universität Stuttgart,Institut für Technische Optik
[4] Massachusetts Institute of Technology,Department of Mechanical Engineering
[5] University of Chinese Academy of Sciences,Hangzhou Institute for Advanced Study
来源
Light: Science & Applications | / 9卷
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Most of the neural networks proposed so far for computational imaging (CI) in optics employ a supervised training strategy, and thus need a large training set to optimize their weights and biases. Setting aside the requirements of environmental and system stability during many hours of data acquisition, in many practical applications, it is unlikely to be possible to obtain sufficient numbers of ground-truth images for training. Here, we propose to overcome this limitation by incorporating into a conventional deep neural network a complete physical model that represents the process of image formation. The most significant advantage of the resulting physics-enhanced deep neural network (PhysenNet) is that it can be used without training beforehand, thus eliminating the need for tens of thousands of labeled data. We take single-beam phase imaging as an example for demonstration. We experimentally show that one needs only to feed PhysenNet a single diffraction pattern of a phase object, and it can automatically optimize the network and eventually produce the object phase through the interplay between the neural network and the physical model. This opens up a new paradigm of neural network design, in which the concept of incorporating a physical model into a neural network can be generalized to solve many other CI problems.
引用
收藏
相关论文
共 34 条
[1]  
Barbastathis G(2019)On the use of deep learning for computational imaging Optica 6 921-943
[2]  
Ozcan A(2015)Learning approach to optical tomography Optica 2 517-522
[3]  
Situ G(2017)Deep-learning-based ghost imaging Sci. Rep. 7 25560-25572
[4]  
Kamilov US(2019)Learning from simulation: an end-to-end deep-learning approach for computational ghost imaging Opt. Express 27 337-344
[5]  
Lyu M(2018)Learning-based nonparametric autofocusing for digital holography Optica 5 17141-1190
[6]  
Wang F(2018)Phase recovery and holographic image reconstruction using deep learning in neural networks Light Sci. Appl. 7 036002-813
[7]  
Ren ZB(2019)Learning-based lensless imaging through optically thick scattering media Adv. Photonics 1 1181-2564
[8]  
Xu ZM(2018)Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media Optica 5 803-1125
[9]  
Lam EY(2018)Imaging through glass diffusers using densely connected convolutional networks Optica 5 2561-2882
[10]  
Rivenson Y(2016)Artificial neural network approaches for fluorescence lifetime imaging techniques Opt. Lett. 41 243902-629