Self-organizing maps whose topologies can be learned with adaptive binary search trees using conditional rotations

被引:9
作者
Astudillo, Cesar A. [1 ]
Oommen, B. John [2 ]
机构
[1] Univ Talca, Dept Comp Sci, Merced 437, Curico, Chile
[2] Carleton Univ, Sch Comp Sci, Ottawa, ON K1S 5B6, Canada
关键词
Adaptive data structures; Binary search trees; Self-organizing maps; NEIGHBORHOOD PRESERVATION; PATTERN-RECOGNITION; NETWORK;
D O I
10.1016/j.patcog.2013.04.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Numerous variants of Self-Organizing Maps (SOMs) have been proposed in the literature, including those which also possess an underlying structure, and in some cases, this structure itself can be defined by the user. Although the concepts of growing the SOM and updating it have been studied, the whole issue of using a self-organizing Adaptive Data Structure (ADS) to further enhance the properties of the underlying SUM, has been unexplored. In an earlier work, we impose an arbitrary, user-defined, tree-like topology onto the codebooks, which consequently enforced a neighborhood phenomenon and the so-called tree-based Bubble of Activity (BoA). In this paper, we consider how the underlying tree itself can be rendered dynamic and adaptively transformed. To do this, we present methods by which a SUM with an underlying Binary Search Tree (BST) structure can be adaptively re-structured using Conditional Rotations (CONROT). These rotations on the nodes of the tree are local, can be done in constant time, and performed so as to decrease the Weighted Path Length (WPL) of the entire tree. In doing this, we introduce the pioneering concept referred to as Neural Promotion, where neurons gain prominence in the Neural Network (NN) as their significance increases. We are not aware of any research which deals with the issue of Neural Promotion. The advantage of such a scheme is that the user need not be aware of any of the topological peculiarities of the stochastic data distribution. Rather, the algorithm, referred to as the TTOSOM with Conditional Rotations (TTOCONROT), converges in such a manner that the neurons are ultimately placed in the input space so as to represent its stochastic distribution, and additionally, the neighborhood properties of the neurons suit the best BST that represents the data. These properties have been confirmed by our experimental results on a variety of data sets. We submit that all these concepts are both novel and of a pioneering sort. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:96 / 113
页数:18
相关论文
共 56 条
[1]  
ADELSONVELSKII GM, 1962, DOKL AKAD NAUK SSSR+, V146, P263
[2]  
Akram M.U., PATTERN RECOGNITION, V46
[3]   Dynamic self-organizing maps with controlled growth for knowledge discovery [J].
Alahakoon, D ;
Halgamuge, SK ;
Srinivasan, B .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (03) :601-614
[4]   SELF-ORGANIZING BINARY SEARCH TREES [J].
ALLEN, B ;
MUNRO, I .
JOURNAL OF THE ACM, 1978, 25 (04) :526-535
[5]  
[Anonymous], 1890, Math. Ann.
[6]  
[Anonymous], 2003, Neural Comput. Surv
[7]  
[Anonymous], THESIS U TEXAS AUSTI
[8]  
[Anonymous], 1973, Pattern Classification and Scene Analysis
[9]  
Astudillo C.A., 2011, THESIS CARLETON U
[10]   On achieving semi-supervised pattern recognition by utilizing tree-based SOMs [J].
Astudillo, Cesar A. ;
Oommen, B. John .
PATTERN RECOGNITION, 2013, 46 (01) :293-304