Topological Clustering via Adaptive Resonance Theory With Information Theoretic Learning

被引:21
作者
Masuyama, Naoki [1 ]
Loo, Chu Kiong [2 ]
Ishibuchi, Hisao [3 ]
Kubota, Naoyuki [4 ]
Nojima, Yusuke [1 ]
Liu, Yiping [1 ]
机构
[1] Osaka Prefecture Univ, Grad Sch Engn, Osaka 5998531, Japan
[2] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur 50603, Malaysia
[3] Southern Univ Sci & Technol, Shenzhen Key Lab Computat Intelligence, Univ Key Lab Evolving Intelligent Syst Guangdong, Dept Comp Sci & Engn, Shenzhen 518055, Peoples R China
[4] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo 1910065, Japan
基金
中国国家自然科学基金;
关键词
Adaptive resonance theory; correntropy; information theoretic learning; topological clustering; INCREMENTAL NEURAL-NETWORK; SELF-ORGANIZING NETWORK; CORRENTROPY; ALGORITHM; PATTERNS; ART;
D O I
10.1109/ACCESS.2019.2921832
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a topological clustering algorithm by integrating topological structure and information theoretic learning, i.e., correntropy, into adaptive resonance theory (ART). Specifically, the proposed algorithm utilizes the correntropy induced metric (CIM) for defining a similarity measure, a node insertion criterion, and an edge creation criterion. Other types of the ART-based topological clustering algorithms have been developed, however, these algorithms have various drawbacks such as a large number of parameters, sensitivity to noisy data. Moreover, generated topological networks cannot represent the distribution of data. In contrast, the proposed algorithm realizes a stable computation and reduces the number of parameters compared to existing algorithms. Furthermore, improving the ability to express the data structure more appropriately by the topological network, a mechanism that adaptively controls the node insertion criterion is introduced to the proposed algorithm. The experimental results showed that the proposed algorithm has superior performance with respect to the self-organizing and the classification abilities compared with the state-of-the-art topological clustering algorithms.
引用
收藏
页码:76920 / 76936
页数:17
相关论文
共 50 条
[31]   Incremental learning framework for function approximation, via combining mixture of expert model and adaptive resonance theory [J].
Kim, Cheoltaek ;
Lee, Ju-Jang .
2007 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS I-V, CONFERENCE PROCEEDINGS, 2007, :3486-3491
[32]   Selective Ensemble of SVDDs Based on Information Theoretic Learning [J].
Xing, Hong-Jie ;
Wei, Yong-Le .
PROCEEDINGS OF 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2015), 2015, :719-723
[33]   Pretrained back propagation based adaptive resonance theory network for adaptive learning [J].
Zhang, Caixia ;
Jiang, Cong ;
Xu, Qingyang .
JOURNAL OF ALGORITHMS & COMPUTATIONAL TECHNOLOGY, 2023, 17
[34]   Soft-clustering and improved stability for adaptive resonance theory neural networksication [J].
Massey, Louis .
SOFT COMPUTING, 2008, 12 (07) :657-665
[35]   Information Theoretic Clustering for an Intelligent Multilingual Tutoring System [J].
Troussas, C. ;
Virvou, M. .
INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2013, 8 (06) :55-61
[36]   Weighted Error Entropy-Based Information Theoretic Learning for Robust Subspace Representation [J].
Li, Yuanman ;
Zhou, Jiantao ;
Tian, Jinyu ;
Zheng, Xianwei ;
Tang, Yuan Yan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) :4228-4242
[37]   Fractional Adaptive Resonance Theory (FRA-ART): An Extension for a Stream Clustering Method with Enhanced Data Representation [J].
Zhu, Yingwen ;
Li, Ping ;
Zhang, Qian ;
Zhu, Yi ;
Yang, Jun .
MATHEMATICS, 2024, 12 (13)
[38]   Robot behaviour learning using Topological Gaussian Adaptive Resonance Hidden Markov Model [J].
Farhan Dawood ;
Chu Kiong Loo .
Neural Computing and Applications, 2016, 27 :2509-2522
[39]   Incremental Local Distribution-Based Clustering Using Bayesian Adaptive Resonance Theory [J].
Wang, Ling ;
Zhu, Hui ;
Meng, Jianyao ;
He, Wei .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (11) :3496-3504
[40]   Conceptual duplicationSoft-clustering and improved stability for adaptive resonance theory neural networks [J].
Louis Massey .
Soft Computing, 2008, 12 :657-665