Metaplasticity-Enabled Graphene Quantum Dot Devices for Mitigating Catastrophic Forgetting in Artificial Neural Networks

被引:0
|
作者
Fan, Xuemeng [1 ,2 ]
Chen, Anzhe [1 ,2 ]
Li, Zongwen [1 ,2 ]
Gong, Zhihao [2 ]
Wang, Zijian [1 ,2 ]
Zhang, Guobin [1 ,2 ]
Li, Pengtao [1 ,2 ]
Xu, Yang [1 ,2 ]
Wang, Hua [1 ,2 ]
Wang, Changhong [3 ]
Zhu, Xiaolei [1 ,2 ]
Zhao, Rong [4 ]
Yu, Bin [1 ,2 ]
Zhang, Yishu [1 ,2 ]
机构
[1] Zhejiang Univ, Sch Integrated Circuits, Hangzhou 311200, Zhejiang, Peoples R China
[2] ZJU Hangzhou Global Sci & Technol Innovat Ctr, Hangzhou 310027, Zhejiang, Peoples R China
[3] Eastern Inst Technol, Eastern Inst Adv Study, Ningbo 315200, Peoples R China
[4] Tsinghua Univ, Dept Precis Instruments, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
catastrophic forgetting; GQDs; metaplasticity; synaptic devices; TRANSISTORS; MODELS;
D O I
10.1002/adma.202411237
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The limitations of deep neural networks in continuous learning stem from oversimplifying the complexities of biological neural circuits, often neglecting the dynamic balance between memory stability and learning plasticity. In this study, artificial synaptic devices enhanced with graphene quantum dots (GQDs) that exhibit metaplasticity is introduced, a higher-order form of synaptic plasticity that facilitates the dynamic regulation of memory and learning processes similar to those observed in biological systems. The GQDs-assisted devices utilize interface-mediated modifications in asymmetric conductive pathways, replicating classical synaptic plasticity mechanisms. This allows for repeatable and linearly programmable adjustments to future weight changes linked to historical weights. Incorporating metaplasticity is essential for achieving generalization within deep neural networks, which enables them to adapt more fluidly to new information while retaining previously acquired knowledge. The GQDs-device-based system achieved a 97% accuracy on the fourth MNIST dataset task, while consistently achieving performance levels above 94% on prior tasks. This performance substantiates the feasibility of directly transferring metaplasticity principles to deep neural networks, thereby addressing the challenges associated with catastrophic forgetting. These findings present a promising hardware solution for developing neuromorphic systems with robust and sustained learning capabilities that can effectively bridge the gap between artificial and biological neural networks.
引用
收藏
页数:11
相关论文
共 2 条