iCVI-ARTMAP: Using Incremental Cluster Validity Indices and Adaptive Resonance Theory Reset Mechanism to Accelerate Validation and Achieve Multiprototype Unsupervised Representations

被引:6
作者
da Silva, L. E. Brito [1 ]
Rayapati, Nagasharath [1 ]
Wunsch, Donald C., II [2 ]
机构
[1] Guise AI Inc, Rolla, MO 65401 USA
[2] Missouri Univ Sci & Technol, Dept Elect & Comp Engn, Rolla, MO 65401 USA
关键词
Subspace constraints; Clustering algorithms; Merging; Adaptation models; Partitioning algorithms; Prototypes; Machine learning algorithms; Adaptive resonance theory (ART); adaptive resonance theory predictive mapping (ARTMAP); clustering; incremental cluster validity indices (iCVIs); validation; EMOTION RECOGNITION; MENTAL-STRESS; FUZZY ARTMAP; FACE RECOGNITION; NEURAL-NETWORKS; ARCHITECTURE; EXTENSIONS; ATTENTION; NUMBER; MODEL;
D O I
10.1109/TNNLS.2022.3160381
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article presents an adaptive resonance theory predictive mapping (ARTMAP) model, which uses incremental cluster validity indices (iCVIs) to perform unsupervised learning, namely, iCVI-ARTMAP. Incorporating iCVIs to the decision-making and many-to-one mapping capabilities of this adaptive resonance theory (ART)-based model can improve the choices of clusters to which samples are incrementally assigned. These improvements are accomplished by intelligently performing the operations of swapping sample assignments between clusters, splitting and merging clusters, and caching the values of variables when iCVI values need to be recomputed. Using recursive formulations enables iCVI-ARTMAP to considerably reduce the computational burden associated with cluster validity index (CVI)-based offline clustering. In this work, six iCVI-ARTMAP variants were realized via the integration of one information-theoretic and five sum-of-squares-based iCVIs into fuzzy ARTMAP. With proper choice of iCVI, iCVI-ARTMAP either outperformed or performed comparably to three ART-based and four non-ART-based clustering algorithms in experiments using benchmark datasets of different natures. Naturally, the performance of iCVI-ARTMAP is subject to the selected iCVI and its suitability to the data at hand; fortunately, it is a general model in which other iCVIs can be easily embedded.
引用
收藏
页码:9757 / 9770
页数:14
相关论文
共 98 条
[1]  
[Anonymous], 2011, J. Mach. Learn. Res
[2]  
[Anonymous], UCI machine learning repository
[3]   Information-theoretic clustering: A representative and evolutionary approach [J].
Araujo, Daniel ;
Doria Neto, Adriao ;
Martins, Allan .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (10) :4190-4205
[4]   An extensive comparative study of cluster validity indices [J].
Arbelaitz, Olatz ;
Gurrutxaga, Ibai ;
Muguerza, Javier ;
Perez, Jesus M. ;
Perona, Inigo .
PATTERN RECOGNITION, 2013, 46 (01) :243-256
[5]  
Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
[6]  
BARTFAI G, 1994, 1994 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOL 1-7, P940, DOI 10.1109/ICNN.1994.374307
[7]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[8]   Online clustering of parallel data streams [J].
Beringer, Juergen ;
Huellermeier, Eyke .
DATA & KNOWLEDGE ENGINEERING, 2006, 58 (02) :180-204
[9]   A geometric approach to cluster validity for normal mixtures [J].
J. C. Bezdek ;
W. Q. Li ;
Y. Attikiouzel ;
M. Windham .
Soft Computing, 1997, 1 (4) :166-179
[10]   Some new indexes of cluster validity [J].
Bezdek, JC ;
Pal, NR .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1998, 28 (03) :301-315