Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability

被引:17
作者
Chen, Zhenjia [1 ,2 ]
Lin, Zhenyuan [1 ,2 ]
Yang, Ji [3 ]
Chen, Cong [1 ,2 ]
Liu, Di [1 ,2 ]
Shan, Liuting [1 ,2 ]
Hu, Yuanyuan [4 ]
Guo, Tailiang [1 ,2 ]
Chen, Huipeng [1 ,2 ]
机构
[1] Fuzhou Univ, Inst Optoelect Display, Natl & Local United Engn Lab Flat Panel Display Te, Fuzhou 350002, Peoples R China
[2] Fujian Sci & Technol Innovat Lab Optoelect Informa, Fuzhou 350100, Peoples R China
[3] Fuzhou Univ, Coll Comp & Data Sci, Fuzhou, Fujian, Peoples R China
[4] Hunan Univ, Changsha Semicond Technol & Applicat Innovat Res I, Coll Semicond, Coll Integrated Circuits, Changsha 410082, Peoples R China
基金
中国国家自然科学基金;
关键词
INTELLIGENCE;
D O I
10.1038/s41467-024-46246-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deep neural networks have revolutionized several domains, including autonomous driving, cancer detection, and drug design, and are the foundation for massive artificial intelligence models. However, hardware neural network reports still mainly focus on shallow networks (2 to 5 layers). Implementing deep neural networks in hardware is challenging due to the layer-by-layer structure, resulting in long training times, signal interference, and low accuracy due to gradient explosion/vanishing. Here, we utilize negative ultraviolet photoconductive light-emitting memristors with intrinsic parallelism and hardware-software co-design to achieve electrical information's optical cross-layer transmission. We propose a hybrid ultra-deep photoelectric neural network and an ultra-deep super-resolution reconstruction neural network using light-emitting memristors and cross-layer block, expanding the networks to 54 and 135 layers, respectively. Further, two networks enable transfer learning, approaching or surpassing software-designed networks in multi-dataset recognition and high-resolution restoration tasks. These proposed strategies show great potential for high-precision multifunctional hardware neural networks and edge artificial intelligence. Parallel information transmission components and hardware strategies are still lacking in neural networks. Here, the authors propose a strategy to use light emitting memristors with negative ultraviolet photoconductivity and intrinsic parallelism to construct direct information cross-layer modules.
引用
收藏
页数:12
相关论文
共 51 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Deep learning-based robust positioning for all-weather autonomous driving [J].
Almalioglu, Yasin ;
Turan, Mehmet ;
Trigoni, Niki ;
Markham, Andrew .
NATURE MACHINE INTELLIGENCE, 2022, 4 (09) :749-+
[3]   Quantitative Assessment of Single-Image Super-Resolution in Myocardial Scar Imaging [J].
Ashikaga, Hiroshi ;
Estner, Heidi L. ;
Herzka, Daniel A. ;
Mcveigh, Elliot R. ;
Halperin, Henry R. .
IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2014, 2
[4]   An on-chip photonic deep neural network for image classification [J].
Ashtiani, Farshid ;
Geers, Alexander J. ;
Aflatouni, Firooz .
NATURE, 2022, 606 (7914) :501-+
[5]   Mind evolutionary algorithm optimization in the prediction of satellite clock bias using the back propagation neural network [J].
Bai, Hongwei ;
Cao, Qianqian ;
An, Subang .
SCIENTIFIC REPORTS, 2023, 13 (01)
[6]   Searching for exotic particles in high-energy physics with deep learning [J].
Baldi, P. ;
Sadowski, P. ;
Whiteson, D. .
NATURE COMMUNICATIONS, 2014, 5
[7]   Accurate medium-range global weather forecasting with 3D neural networks [J].
Bi, Kaifeng ;
Xie, Lingxi ;
Zhang, Hengheng ;
Chen, Xin ;
Gu, Xiaotao ;
Tian, Qi .
NATURE, 2023, 619 (7970) :533-+
[8]  
Ceranik K, 1997, J NEUROSCI, V17, P5380
[9]   Gene expression based inference of cancer drug sensitivity [J].
Chawla, Smriti ;
Rockstroh, Anja ;
Lehman, Melanie ;
Ratther, Ellca ;
Jain, Atishay ;
Anand, Anuneet ;
Gupta, Apoorva ;
Bhattacharya, Namrata ;
Poonia, Sarita ;
Rai, Priyadarshini ;
Das, Nirjhar ;
Majumdar, Angshul ;
Jayadeva ;
Ahuja, Gaurav ;
Hollier, Brett G. ;
Nelson, Colleen C. ;
Sengupta, Debarka .
NATURE COMMUNICATIONS, 2022, 13 (01)
[10]   Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging [J].
Chen, Rong ;
Tang, Xiao ;
Zhao, Yuxuan ;
Shen, Zeyu ;
Zhang, Meng ;
Shen, Yusheng ;
Li, Tiantian ;
Chung, Casper Ho Yin ;
Zhang, Lijuan ;
Wang, Ji ;
Cui, Binbin ;
Fei, Peng ;
Guo, Yusong ;
Du, Shengwang ;
Yao, Shuhuai .
NATURE COMMUNICATIONS, 2023, 14 (01)