Fourier-space Diffractive Deep Neural Network

被引:307
作者
Yan, Tao [1 ]
Wu, Jiamin [1 ]
Zhou, Tiankuang [1 ,2 ]
Xie, Hao [1 ]
Xu, Feng [3 ]
Fan, Jingtao [1 ]
Fang, Lu [2 ]
Lin, Xing [1 ,4 ]
Dai, Qionghai [1 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
[3] Tsinghua Univ, Sch Software, Beijing 100084, Peoples R China
[4] Univ Calif Los Angeles, Dept Elect & Comp Engn, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
SALIENT OBJECT DETECTION;
D O I
10.1103/PhysRevLett.123.023901
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In this Letter we propose the Fourier-space diffractive deep neural network (F-(DNN)-N-2) for all-optical image processing that performs advanced computer vision tasks at the speed of light. The F-(DNN)-N-2 is achieved by placing the extremely compact diffractive modulation layers at the Fourier plane or both Fourier and imaging planes of an optical system, where the optical nonlinearity is introduced from ferroelectric thin films. We demonstrated that F-(DNN)-N-2 can be trained with deep learning algorithms for all-optical saliency detection and high-accuracy object classification.
引用
收藏
页数:6
相关论文
共 42 条
[1]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Sihite, Dicky N. ;
Itti, Laurent .
COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 :414-429
[2]  
Boyd R. W., 2020, NONLINEAR OPTICS
[3]   Multiscale gigapixel photography [J].
Brady, D. J. ;
Gehm, M. E. ;
Stack, R. A. ;
Marks, D. L. ;
Kittle, D. S. ;
Golish, D. R. ;
Vera, E. M. ;
Feller, S. D. .
NATURE, 2012, 486 (7403) :386-389
[4]   Parallel photonic information processing at gigabyte per second data rates using transient states [J].
Brunner, Daniel ;
Soriano, Miguel C. ;
Mirasso, Claudio R. ;
Fischer, Ingo .
NATURE COMMUNICATIONS, 2013, 4
[5]   Reinforcement learning in a large-scale photonic recurrent neural network [J].
Bueno, J. ;
Maktoobi, S. ;
Froehly, L. ;
Fischer, I. ;
Jacquot, M. ;
Larger, L. ;
Brunner, D. .
OPTICA, 2018, 5 (06) :756-760
[6]   Toward Fast Neural Computing using All-Photonic Phase Change Spiking Neurons [J].
Chakraborty, Indranil ;
Saha, Gobinda ;
Sengupta, Abhronil ;
Roy, Kaushik .
SCIENTIFIC REPORTS, 2018, 8
[7]   Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification [J].
Chang, Julie ;
Sitzmann, Vincent ;
Dun, Xiong ;
Heidrich, Wolfgang ;
Wetzstein, Gordon .
SCIENTIFIC REPORTS, 2018, 8
[8]   Analog optical computing based on a dielectric meta-reflect array [J].
Chizari, Ata ;
Abdollahramezani, Sajjad ;
Jamali, Mohammad Vahid ;
Salehi, Jawad A. .
OPTICS LETTERS, 2016, 41 (15) :3451-3454
[9]   Theory of incoherent self-focusing in biased photorefractive media [J].
Christodoulides, DN ;
Coskun, TH ;
Mitchell, M ;
Segev, M .
PHYSICAL REVIEW LETTERS, 1997, 78 (04) :646-649
[10]  
Cornia M, 2016, INT C PATT RECOG, P3488, DOI 10.1109/ICPR.2016.7900174