Physics-based neural network for non-invasive control of coherent light in scattering media

被引:15
作者
D'Arco, Alexandra [1 ]
Xia, Fei [1 ]
Boniface, Antoine [1 ,2 ]
Dong, Jonathan [1 ,3 ]
Gigan, Sylvain [1 ]
机构
[1] Sorbonne Univ, Coll France, Lab Kastler Brossel, ENS Univ PSL, 24 Rue Lhomond, F-75005 Paris, France
[2] Ecole Polytech Fed Lausanne EPFL, Lab Appl Photon Devices, CH-1015 Lausanne, Switzerland
[3] Ecole Polytech Fed Lausanne EPFL, Biomed Imaging Grp, CH-1015 Lausanne, Switzerland
基金
欧洲研究理事会; 欧盟地平线“2020”;
关键词
FOCUSING LIGHT; TRANSMISSION; WAVES;
D O I
10.1364/OE.465702
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Optical imaging through complex media, such as biological tissues or fog, is challenging due to light scattering. In the multiple scattering regime, wavefront shaping provides an effective method to retrieve information; it relies on measuring how the propagation of different optical wavefronts are impacted by scattering. Based on this principle, several wavefront shaping techniques were successfully developed, but most of them are highly invasive and limited to proof-of-principle experiments. Here, we propose to use a neural network approach to non-invasively characterize and control light scattering inside the medium and also to retrieve information of hidden objects buried within it. Unlike most of the recently-proposed approaches, the architecture of our neural network with its layers, connected nodes and activation functions has a true physical meaning as it mimics the propagation of light in our optical system. It is trained with an experimentally-measured input/output dataset built from a series of incident light patterns and corresponding camera snapshots. We apply our physics-based neural network to a fluorescence microscope in epi-configuration and demonstrate its performance through numerical simulations and experiments. This flexible method can include physical priors and we show that it can be applied to other systems as, for example, non-linear or coherent contrast mechanisms. (C) 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
引用
收藏
页码:30845 / 30856
页数:12
相关论文
共 38 条
  • [1] On the use of deep learning for computational imaging
    Barbastathis, George
    Ozcan, Aydogan
    Situ, Guohai
    [J]. OPTICA, 2019, 6 (08): : 921 - 943
  • [2] Non-invasive imaging through opaque scattering layers
    Bertolotti, Jacopo
    van Putten, Elbert G.
    Blum, Christian
    Lagendijk, Ad
    Vos, Willem L.
    Mosk, Allard P.
    [J]. NATURE, 2012, 491 (7423) : 232 - 234
  • [3] Boniface A., US
  • [4] Non-invasive focusing and imaging in scattering media with a fluorescence-based transmission matrix
    Boniface, Antoine
    Dong, Jonathan
    Gigan, Sylvain
    [J]. NATURE COMMUNICATIONS, 2020, 11 (01)
  • [5] Noninvasive light focusing in scattering media using speckle variance optimization
    Boniface, Antoine
    Blochet, Baptiste
    Dong, Jonathan
    Gigan, Sylvain
    [J]. OPTICA, 2019, 6 (11): : 1381 - 1385
  • [6] Bottou L., 1991, Proc. Neuro-Nimes, V91, P12
  • [7] Transmission of natural scene images through a multimode fibre
    Caramazza, Piergiorgio
    Moran, Oisin
    Murray-Smith, Roderick
    Faccio, Daniele
    [J]. NATURE COMMUNICATIONS, 2019, 10 (1)
  • [8] Chaigne T, 2014, NAT PHOTONICS, V8, P59, DOI [10.1038/NPHOTON.2013.307, 10.1038/nphoton.2013.307]
  • [9] dArco A., US
  • [10] CORRELATIONS AND FLUCTUATIONS OF COHERENT WAVE TRANSMISSION THROUGH DISORDERED MEDIA
    FENG, SC
    KANE, C
    LEE, PA
    STONE, AD
    [J]. PHYSICAL REVIEW LETTERS, 1988, 61 (07) : 834 - 837