Multi-agent Reinforcement Learning Using Simulated Quantum Annealing

被引:7
作者
Neumann, Niels M. P. [1 ]
de Heer, Paolo B. U. L. [1 ]
Chiscop, Irina [1 ]
Phillipson, Frank [1 ]
机构
[1] Netherlands Org Appl Sci Res, Anna van Buerenpl 1, NL-2595 DA The Hague, Netherlands
来源
COMPUTATIONAL SCIENCE - ICCS 2020, PT VI | 2020年 / 12142卷
关键词
Multi-agent; Reinforcement learning; Quantum computing; D-Wave; Quantum annealing;
D O I
10.1007/978-3-030-50433-5_43
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With quantum computers still under heavy development, already numerous quantum machine learning algorithms have been proposed for both gate-based quantum computers and quantum annealers. Recently, a quantum annealing version of a reinforcement learning algorithm for grid-traversal using one agent was published. We extend this work based on quantum Boltzmann machines, by allowing for any number of agents. We show that the use of quantum annealing can improve the learning compared to classical methods. We do this both by means of actual quantum hardware and by simulated quantum annealing.
引用
收藏
页码:562 / 575
页数:14
相关论文
共 29 条
[1]  
ACKLEY DH, 1985, COGNITIVE SCI, V9, P147
[2]   Solving the Rubik's cube with deep reinforcement learning and search [J].
Agostinelli, Forest ;
McAleer, Stephen ;
Shmakov, Alexander ;
Baldi, Pierre .
NATURE MACHINE INTELLIGENCE, 2019, 1 (08) :356-363
[3]   Reinforcement learning-based multi-agent system for network traffic signal control [J].
Arel, I. ;
Liu, C. ;
Urbanik, T. ;
Kohls, A. G. .
IET INTELLIGENT TRANSPORT SYSTEMS, 2010, 4 (02) :128-135
[4]   Thermal, quantum and simulated quantum annealing: analytical comparisons for simple models [J].
Bapst, V. ;
Semerjian, G. .
ELC INTERNATIONAL MEETING ON INFERENCE, COMPUTATION, AND SPIN GLASSES (ICSG2013), 2013, 473
[6]   A MARKOVIAN DECISION PROCESS [J].
BELLMAN, R .
JOURNAL OF MATHEMATICS AND MECHANICS, 1957, 6 (05) :679-684
[7]   Quantum-assisted Helmholtz machines: A quantum-classical deep learning framework for industrial datasets in near-term devices [J].
Benedetti, Marcello ;
Realpe-Gomez, John ;
Perdomo-Ortiz, Alejandro .
QUANTUM SCIENCE AND TECHNOLOGY, 2018, 3 (03)
[8]  
Crawford D., CORR, V1612
[9]   Simulated Quantum Annealing Can Be Exponentially Faster than Classical Simulated Annealing [J].
Crosson, Elizabeth ;
Harrow, Aram W. .
2016 IEEE 57TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2016, :714-723
[10]   Quantum reinforcement learning [J].
Dong, Daoyi ;
Chen, Chunlin ;
Li, Hanxiong ;
Tarn, Tzyh-Jong .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (05) :1207-1220