Zero-power optical convolutional neural network using incoherent light

被引:6
作者
Fei, Yuhang [1 ]
Sui, Xiubao [1 ]
Gu, Guohua [1 ]
Chen, Qian [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect & Opt Engn, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Optical neural network; Irregular convolution; Incoherent light; Zero-power consumption;
D O I
10.1016/j.optlaseng.2022.107410
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
As a new high-speed intelligent computing method, optical neural network (ONN) has the advantage of realizing lower or even zero power computing. For example, the diffractive neural networks based on passive diffraction layer can work without power consumption. However, in the realization methods of current ONN, coherent light is used to carry input information, while the light in the natural scene is incoherent light, which makes it difficult to apply ONN to the actual optical scene for physical observation. In this paper, we propose an irregular incoherent optical convolutional neural network (I2OCNN). The network only uses the reflection and transmission properties of light to realize the controllable rearrangement of two-dimensional incoherent light field on a series of passive optical devices, so as to realize the cross interconnection of optical neurons, and thus realizes the optical convolution neural network of incoherent light with zero power consumption. Since the architecture is based on intensity modulation and incoherent superposition, incoherent light can be used to carry input signals, which solves the problem of practical application of ONN. In addition, the network can achieve irregular convolution. MNIST and Fashion MNIST were used to verify the image recognition capability of 7-layer I2OCNN, and the testing accuracy was 86.95% and 75.68%, respectively. Theoretical reasoning and simulation results show that this architecture can complete the basic image recognition tasks under the condition of incoherence and zero power consumption.
引用
收藏
页数:10
相关论文
共 34 条
[1]   Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification [J].
Chang, Julie ;
Sitzmann, Vincent ;
Dun, Xiong ;
Heidrich, Wolfgang ;
Wetzstein, Gordon .
SCIENTIFIC REPORTS, 2018, 8
[2]   Diffractive Deep Neural Networks at Visible Wavelengths [J].
Chen, Hang ;
Feng, Jianan ;
Jiang, Minwei ;
Wang, Yiqun ;
Lin, Jie ;
Tan, Jiubin ;
Jin, Peng .
ENGINEERING, 2021, 7 (10) :1483-1491
[3]   Optical frontend for a convolutions neural network [J].
Colburn, Shane ;
Chu, Yi ;
Shilzerman, Eli ;
Majumdar, Arka .
APPLIED OPTICS, 2019, 58 (12) :3179-3186
[4]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[5]   OPTICAL IMPLEMENTATION OF THE HOPFIELD MODEL [J].
FARHAT, NH ;
PSALTIS, D ;
PRATA, A ;
PAEK, E .
APPLIED OPTICS, 1985, 24 (10) :1469-1475
[6]   Parallel convolutional processing using an integrated photonic tensor core [J].
Feldmann, J. ;
Youngblood, N. ;
Karpov, M. ;
Gehring, H. ;
Li, X. ;
Stappers, M. ;
Le Gallo, M. ;
Fu, X. ;
Lukashchuk, A. ;
Raja, A. S. ;
Liu, J. ;
Wright, C. D. ;
Sebastian, A. ;
Kippenberg, T. J. ;
Pernice, W. H. P. ;
Bhaskaran, H. .
NATURE, 2021, 589 (7840) :52-+
[7]  
Goodman J. W., 1968, Introduction to Fourier Optics
[8]   Optronic convolutional neural networks of multi- layers with different functions executed in optics for image classification [J].
Gu, Ziyu ;
Gao, Yesheng ;
Liu, Xingzhao .
OPTICS EXPRESS, 2021, 29 (04) :5877-5889
[9]   Deep Convolutional Neural Network for Inverse Problems in Imaging [J].
Jin, Kyong Hwan ;
McCann, Michael T. ;
Froustey, Emmanuel ;
Unser, Michael .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (09) :4509-4522
[10]   Reconstruction of 3D Object Shape Using Hybrid Modular Neural Network Architecture Trained on 3D Models from ShapeNetCore Dataset [J].
Kulikajevas, Audrius ;
Maskeliunas, Rytis ;
Damasevicius, Robertas ;
Misra, Sanjay .
SENSORS, 2019, 19 (07)