Ising formulation of associative memory models and quantum annealing recall

被引:8
作者
Santra, Siddhartha [1 ,2 ]
Shehab, Omar [3 ]
Balu, Radhakrishnan [1 ]
机构
[1] US Army Res Lab, Computat & Informat Sci Directorate, ATTN CIH N, Aberdeen Proving Ground, MD 21005 USA
[2] Stanford Univ, Dept Aeronaut & Astronaut, 496 Lomita Mall, Stanford, CA 94305 USA
[3] Univ Maryland Baltimore Cty, Dept Comp Sci & Elect Engn, 1000 Hilltop Circle, Baltimore, MD 21250 USA
关键词
NEURAL-NETWORKS; OPTIMIZATION; CIRCUITS;
D O I
10.1103/PhysRevA.96.062330
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Associative memory models, in theoretical neuro- and computer sciences, can generally store at most a linear number of memories. Recalling memories in these models can be understood as retrieval of the energy minimizing configuration of classical Ising spins, closest in Hamming distance to an imperfect input memory, where the energy landscape is determined by the set of stored memories. We present an Ising formulation for associative memory models and consider the problem of memory recall using quantum annealing. We show that allowing for input-dependent energy landscapes allows storage of up to an exponential number of memories (in terms of the number of neurons). Further, we show how quantum annealing may naturally be used for recall tasks in such input-dependent energy landscapes, although the recall time may increase with the number of stored memories. Theoretically, we obtain the radius of attractor basins R(N) and the capacity C(N) of such a scheme and their tradeoffs. Our calculations establish that for randomly chosen memories the capacity of our model using the Hebbian learning rule as a function of problem size can be expressed as C(N) = O(e(C1N)), C-1 >= 0, and succeeds on randomly chosen memory sets with a probability of (1 - e(-C2N)), C-2 >= 0 with C-1 + C-2 = (0.5 - f)(2)/(1 - f), where f = R(N)/N, 0 <= f <= 0.5, is the radius of attraction in terms of the Hamming distance of an input probe from a stored memory as a fraction of the problem size. We demonstrate the application of this scheme on a programmable quantum annealing device, the D-wave processor.
引用
收藏
页数:10
相关论文
共 46 条
[1]   Temperature Scaling Law for Quantum Annealing Optimizers [J].
Albash, Tameem ;
Martin-Mayor, Victor ;
Hen, Itay .
PHYSICAL REVIEW LETTERS, 2017, 119 (11)
[2]   Quantum adiabatic Markovian master equations [J].
Albash, Tameem ;
Boixo, Sergio ;
Lidar, Daniel A. ;
Zanardi, Paolo .
NEW JOURNAL OF PHYSICS, 2012, 14
[3]   Adiabatic quantum optimization with qudits [J].
Amin, Mohammad H. S. ;
Dickson, Neil G. ;
Smith, Peter .
QUANTUM INFORMATION PROCESSING, 2013, 12 (04) :1819-1829
[4]   SPIN-GLASS MODELS OF NEURAL NETWORKS [J].
AMIT, DJ ;
GUTFREUND, H .
PHYSICAL REVIEW A, 1985, 32 (02) :1007-1018
[5]  
[Anonymous], 2003, Discrete Mathematics
[6]  
[Anonymous], 1979, Computers and Intractablity: A Guide to the Theory of NP-Completeness
[7]  
[Anonymous], ARXIV151202900
[8]  
[Anonymous], ARXIV14062741
[9]  
[Anonymous], ARXIV150202098
[10]  
[Anonymous], COMMUNICATION