All-optical image classification through unknown random diffusers using a single-pixel diffractive network

被引:49
作者
Bai, Bijie [1 ,2 ,3 ]
Li, Yuhang [1 ,2 ,3 ]
Luo, Yi [1 ,2 ,3 ]
Li, Xurong [1 ,3 ]
Cetintas, Ege [1 ,2 ,3 ]
Jarrahi, Mona [1 ,3 ]
Ozcan, Aydogan [1 ,2 ,3 ]
机构
[1] Univ Calif Los Angeles, Elect & Comp Engn Dept, Los Angeles, CA 90095 USA
[2] Univ Calif Los Angeles, Bioengn Dept, Los Angeles, CA 90095 USA
[3] Univ Calif Los Angeles, Calif Nano Syst Inst CNSI, Los Angeles, CA 90095 USA
关键词
SCATTERING MEDIA; RECONSTRUCTION;
D O I
10.1038/s41377-023-01116-3
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 87.74 +/- 1.12%. We also experimentally validated our single-pixel broadband diffractive network by classifying handwritten digits "0" and "1" through a random diffuser using terahertz waves and a 3D-printed diffractive network. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving.
引用
收藏
页数:15
相关论文
共 58 条
[1]   Speckle-learning-based object recognition through scattering media [J].
Ando, Takamasa ;
Horisaki, Ryoichi ;
Tanida, Jun .
OPTICS EXPRESS, 2015, 23 (26) :33902-33910
[2]  
[Anonymous], 1989, ADV NEURAL INFORM PR
[3]   To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects [J].
Bai, Bijie ;
Luo, Yi ;
Gan, Tianyi ;
Hu, Jingtian ;
Li, Yuhang ;
Zhao, Yifan ;
Mengu, Deniz ;
Jarrahi, Mona ;
Ozcan, Aydogan .
ELIGHT, 2022, 2 (01)
[4]   Diffractive Deep Neural Networks at Visible Wavelengths [J].
Chen, Hang ;
Feng, Jianan ;
Jiang, Minwei ;
Wang, Yiqun ;
Lin, Jie ;
Tan, Jiubin ;
Jin, Peng .
ENGINEERING, 2021, 7 (10) :1483-1491
[5]   Memory-effect based deconvolution microscopy for super-resolution imaging through scattering media [J].
Edrei, Eitan ;
Scarcelli, Giuliano .
SCIENTIFIC REPORTS, 2016, 6
[6]   Deep learning the high variability and randomness inside multimode fibers [J].
Fan, Pengfei ;
Zhao, Tianrui ;
Su, Lei .
OPTICS EXPRESS, 2019, 27 (15) :20241-20258
[7]  
Hao Z., 2019, IEEE INT CONF COMP V
[8]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[9]  
Horstmeyer R, 2015, NAT PHOTONICS, V9, P563, DOI [10.1038/nphoton.2015.140, 10.1038/NPHOTON.2015.140]
[10]   All-Optical Signal Processing of Vortex Beams with Diffractive Deep Neural Networks [J].
Huang, Zebin ;
Wang, Peipei ;
Liu, Junmin ;
Xiong, Wenjie ;
He, Yanliang ;
Xiao, Jiangnan ;
Ye, Huapeng ;
Li, Ying ;
Chen, Shuqing ;
Fan, Dianyuan .
PHYSICAL REVIEW APPLIED, 2021, 15 (01)