Quantum Continual Learning Overcoming Catastrophic Forgetting

被引:1
作者
蒋文杰 [1 ]
鲁智徳 [1 ]
邓东灵 [1 ,2 ]
机构
[1] Center for Quantum Information, IIIS, Tsinghua University
[2] Shanghai Qi Zhi Institute
关键词
D O I
暂无
中图分类号
O413 [量子论]; TP181 [自动推理、机器学习];
学科分类号
070201 ; 081104 ; 0812 ; 0835 ; 1405 ;
摘要
Catastrophic forgetting describes the fact that machine learning models will likely forget the knowledge of previously learned tasks after the learning process of a new one.It is a vital problem in the continual learning scenario and recently has attracted tremendous concern across different communities.We explore the catastrophic forgetting phenomena in the context of quantum machine learning.It is found that,similar to those classical learning models based on neural networks,quantum learning systems likewise suffer from such forgetting problem in classification tasks emerging from various application scenes.We show that based on the local geometrical information in the loss function landscape of the trained model,a uniform strategy can be adapted to overcome the forgetting problem in the incremental learning setting.Our results uncover the catastrophic forgetting phenomena in quantum machine learning and offer a practical method to overcome this problem,which opens a new avenue for exploring potential quantum advantages towards continual learning.
引用
收藏
页码:29 / 41
页数:13
相关论文
共 28 条
[1]   Information-Theoretic Bounds on Quantum Advantage in Machine Learning [J].
Huang, Hsin-Yuan ;
Kueng, Richard ;
Preskill, John .
PHYSICAL REVIEW LETTERS, 2021, 126 (19)
[2]   Experimental quantum speed-up in reinforcement learning agents [J].
Saggio, V. ;
Asenbeck, B. E. ;
Hamann, A. ;
Stroemberg, T. ;
Schiansky, P. ;
Dunjko, V. ;
Friis, N. ;
Harris, N. C. ;
Hochberg, M. ;
Englund, D. ;
Woelk, S. ;
Briegel, H. J. ;
Walther, P. .
NATURE, 2021, 591 (7849) :229-+
[3]   Expressive power of parametrized quantum circuits [J].
Du, Yuxuan ;
Hsieh, Min-Hsiu ;
Liu, Tongliang ;
Tao, Dacheng .
PHYSICAL REVIEW RESEARCH, 2020, 2 (03)
[4]   Vulnerability of quantum classification to adversarial perturbations [J].
Liu, Nana ;
Wittek, Peter .
PHYSICAL REVIEW A, 2020, 101 (06)
[5]   Quantum convolutional neural networks [J].
Cong, Iris ;
Choi, Soonwon ;
Lukin, Mikhail D. .
NATURE PHYSICS, 2019, 15 (12) :1273-+
[6]   Machine learning and the physical sciences [J].
Carleo, Giuseppe ;
Cirac, Ignacio ;
Cranmer, Kyle ;
Daudet, Laurent ;
Schuld, Maria ;
Tishby, Naftali ;
Vogt-Maranto, Leslie ;
Zdeborova, Lenka .
REVIEWS OF MODERN PHYSICS, 2019, 91 (04)
[7]  
Continual lifelong learning with neural networks: A review[J] . German I. Parisi,Ronald Kemker,Jose L. Part,Christopher Kanan,Stefan Wermter.Neural Networks . 2019
[8]   Quantum Machine Learning in Feature Hilbert Spaces [J].
Schuld, Maria ;
Killoran, Nathan .
PHYSICAL REVIEW LETTERS, 2019, 122 (04)
[9]  
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play[J] . David Silver,Thomas Hubert,Julian Schrittwieser,Ioannis Antonoglou,Matthew Lai,Arthur Guez,Marc Lanctot,Laurent Sifre,Dharshan Kumaran,Thore Graepel,Timothy Lillicrap,Karen Simonyan,Demis Hassabis.Science . 2018 (6419)
[10]   Quantum Generative Adversarial Learning [J].
Lloyd, Seth ;
Weedbrook, Christian .
PHYSICAL REVIEW LETTERS, 2018, 121 (04)