Optimization in "Self-Modeling" Complex Adaptive Systems

被引:32
作者
Watson, Richard A. [1 ]
Buckley, C. L. [2 ]
Mills, Rob [1 ]
机构
[1] Univ Southampton, Nat Syst Grp, Southampton SO17 1BJ, Hants, England
[2] Univ Sussex, Sch Informat, Brighton BN1 9RH, E Sussex, England
关键词
complex adaptive systems; Hopfield networks; self-organization; optimization; associative memory;
D O I
10.1002/cplx.20346
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
When a dynamical system with multiple point attractors is released from an arbitrary initial condition, it will relax into a configuration that locally resolves the constraints or opposing forces between interdependent state variables. However, when there are many conflicting interdependencies between variables, finding a configuration that globally optimizes these constraints by this method is unlikely or may take many attempts. Here, we show that a simple distributed mechanism can incrementally alter a dynamical system such that it finds lower energy configurations, more reliably and more quickly. Specifically, when Hebbian learning is applied to the connections of a simple dynamical system undergoing repeated relaxation, the system will develop an associative memory that amplifies a subset of its own attractor states. This modifies the dynamics of the system such that its ability to find configurations that minimize total system energy, and globally resolve conflicts between interdependent variables, is enhanced. Moreover, we show that the system is not merely "recalling" low energy states that have been previously visited but "predicting" their location by generalizing over local attractor states that have already been visited. This "self-modeling" framework, i.e., a system that augments its behavior with an associative memory of its own attractors, helps us better understand the conditions under which a simple locally mediated mechanism of self-organization can promote significantly enhanced global resolution of conflicts between the components of a complex adaptive system. We illustrate this process in random and modular network constraint problems equivalent to graph coloring and distributed task allocation problems. (C) 2010 Wiley Periodicals, Inc. Complexity 16: 17-26, 2011
引用
收藏
页码:17 / 26
页数:10
相关论文
共 48 条
  • [11] Garey M. R., 1976, Theoretical Computer Science, V1, P237, DOI 10.1016/0304-3975(76)90059-1
  • [12] AN INTERNAL MECHANISM FOR DETECTING PARASITE ATTRACTORS IN A HOPFIELD NETWORK
    GASCUEL, JD
    MOOBED, B
    WEINFELD, M
    [J]. NEURAL COMPUTATION, 1994, 6 (05) : 902 - 915
  • [13] Gross T, 2009, UNDERST COMPLEX SYST, P1, DOI 10.1007/978-3-642-01284-6
  • [14] Hebb D. O., 1949, ORG BEHAV NEUROPSYCH
  • [15] Heylighen F, 2003, IEEE INTELL SYST, V18, P72, DOI 10.1109/MIS.2003.1217631
  • [16] Hinton G. E, 1983, P 5 ANN C COGN SCI R
  • [17] HINTON GE, 1985, P COGN 85 PAR FRANC
  • [18] HOPFIELD JJ, 1985, BIOL CYBERN, V52, P141
  • [19] COMPUTING WITH NEURAL CIRCUITS - A MODEL
    HOPFIELD, JJ
    TANK, DW
    [J]. SCIENCE, 1986, 233 (4764) : 625 - 633
  • [20] UNLEARNING HAS A STABILIZING EFFECT IN COLLECTIVE MEMORIES
    HOPFIELD, JJ
    FEINSTEIN, DI
    PALMER, RG
    [J]. NATURE, 1983, 304 (5922) : 158 - 159