On the Use of Quantum Reinforcement Learning in Energy-Efficiency Scenarios

被引:10
作者
Andres, Eva [1 ]
Pegalajar Cuellar, Manuel [1 ]
Navarro, Gabriel [1 ]
机构
[1] Univ Granada, Dept Comp Sci & Artificial Intelligence, ETSI Informat & Telecomunicac, C Pdta Daniel Saucedo Aranda Sn, Granada 18014, Spain
关键词
quantum neural networks; variational quantum circuits; quantum reinforcement learning; energy efficiency; DATA CENTERS; MANAGEMENT;
D O I
10.3390/en15166034
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
In the last few years, deep reinforcement learning has been proposed as a method to perform online learning in energy-efficiency scenarios such as HVAC control, electric car energy management, or building energy management, just to mention a few. On the other hand, quantum machine learning was born during the last decade to extend classic machine learning to a quantum level. In this work, we propose to study the benefits and limitations of quantum reinforcement learning to solve energy-efficiency scenarios. As a testbed, we use existing energy-efficiency-based reinforcement learning simulators and compare classic algorithms with the quantum proposal. Results in HVAC control, electric vehicle fuel consumption, and profit optimization of electrical charging stations applications suggest that quantum neural networks are able to solve problems in reinforcement learning scenarios with better accuracy than their classical counterpart, obtaining a better cumulative reward with fewer parameters to be learned.
引用
收藏
页数:24
相关论文
共 45 条
[1]  
Badia A.P., 2020, ARXIV
[2]  
Brockman Greg, 2016, arXiv
[3]   Quantum machine learning: a classical perspective [J].
Ciliberto, Carlo ;
Herbster, Mark ;
Ialongo, Alessandro Davide ;
Pontil, Massimiliano ;
Rocchetto, Andrea ;
Severini, Simone ;
Wossnig, Leonard .
PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2018, 474 (2209)
[4]  
Crawley DB, 2000, ASHRAE J, V42, P49
[5]   Quantum reinforcement learning [J].
Dong, Daoyi ;
Chen, Chunlin ;
Li, Hanxiong ;
Tarn, Tzyh-Jong .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (05) :1207-1220
[6]  
Dong H., 2020, DEEP REINFORCEMENT L
[7]  
Dutreilh X, 2011, PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON AUTONOMIC AND AUTONOMOUS SYSTEMS (ICAS 2011), P67
[8]   SIMULATING PHYSICS WITH COMPUTERS [J].
FEYNMAN, RP .
INTERNATIONAL JOURNAL OF THEORETICAL PHYSICS, 1982, 21 (6-7) :467-488
[9]   Applications of reinforcement learning for building energy efficiency control: A review [J].
Fu, Qiming ;
Han, Zhicong ;
Chen, Jianping ;
Lu, You ;
Wu, Hongjie ;
Wang, Yunzhe .
JOURNAL OF BUILDING ENGINEERING, 2022, 50
[10]   Deep Q-Learning for Routing Schemes in SDN-Based Data Center Networks [J].
Fu, Qiongxiao ;
Sun, Enchang ;
Meng, Kang ;
Li, Meng ;
Zhang, Yanhua .
IEEE ACCESS, 2020, 8 :103491-103499