Topological Clustering via Adaptive Resonance Theory With Information Theoretic Learning

被引:19
|
作者
Masuyama, Naoki [1 ]
Loo, Chu Kiong [2 ]
Ishibuchi, Hisao [3 ]
Kubota, Naoyuki [4 ]
Nojima, Yusuke [1 ]
Liu, Yiping [1 ]
机构
[1] Osaka Prefecture Univ, Grad Sch Engn, Osaka 5998531, Japan
[2] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur 50603, Malaysia
[3] Southern Univ Sci & Technol, Shenzhen Key Lab Computat Intelligence, Univ Key Lab Evolving Intelligent Syst Guangdong, Dept Comp Sci & Engn, Shenzhen 518055, Peoples R China
[4] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo 1910065, Japan
来源
IEEE ACCESS | 2019年 / 7卷
基金
中国国家自然科学基金;
关键词
Adaptive resonance theory; correntropy; information theoretic learning; topological clustering; INCREMENTAL NEURAL-NETWORK; SELF-ORGANIZING NETWORK; CORRENTROPY; ALGORITHM; PATTERNS; ART;
D O I
10.1109/ACCESS.2019.2921832
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a topological clustering algorithm by integrating topological structure and information theoretic learning, i.e., correntropy, into adaptive resonance theory (ART). Specifically, the proposed algorithm utilizes the correntropy induced metric (CIM) for defining a similarity measure, a node insertion criterion, and an edge creation criterion. Other types of the ART-based topological clustering algorithms have been developed, however, these algorithms have various drawbacks such as a large number of parameters, sensitivity to noisy data. Moreover, generated topological networks cannot represent the distribution of data. In contrast, the proposed algorithm realizes a stable computation and reduces the number of parameters compared to existing algorithms. Furthermore, improving the ability to express the data structure more appropriately by the topological network, a mechanism that adaptively controls the node insertion criterion is introduced to the proposed algorithm. The experimental results showed that the proposed algorithm has superior performance with respect to the self-organizing and the classification abilities compared with the state-of-the-art topological clustering algorithms.
引用
收藏
页码:76920 / 76936
页数:17
相关论文
共 50 条
  • [1] Adaptive Resonance Theory-Based Topological Clustering With a Divisive Hierarchical Structure Capable of Continual Learning
    Masuyama, Naoki
    Amako, Narito
    Yamada, Yuna
    Nojima, Yusuke
    Ishibuchi, Hisao
    IEEE ACCESS, 2022, 10 : 68042 - 68056
  • [2] Density and Neighbor Adaptive Information Theoretic Clustering
    Wu, Baoyuan
    Hu, Baogang
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 230 - 237
  • [3] Information theoretic learning with adaptive kernels
    Singh, Abhishek
    Principe, Jose C.
    SIGNAL PROCESSING, 2011, 91 (02) : 203 - 213
  • [4] Ant Clustering Algorithm with Information Theoretic Learning
    Boryczka, Urszula
    Boryczka, Mariusz
    INTELLIGENT DECISION TECHNOLOGIES 2016, PT I, 2016, 56 : 325 - 335
  • [5] Class-Wise Classifier Design Capable of Continual Learning Using Adaptive Resonance Theory-Based Topological Clustering
    Masuyama, Naoki
    Nojima, Yusuke
    Dawood, Farhan
    Liu, Zongying
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [6] Adaptive spatial information-theoretic clustering for image segmentation
    Wang, Zhi Min
    Soh, Yeng Chai
    Song, Qing
    Sim, Kang
    PATTERN RECOGNITION, 2009, 42 (09) : 2029 - 2044
  • [7] Privacy-Preserving Continual Federated Clustering via Adaptive Resonance Theory
    Masuyama, Naoki
    Nojima, Yusuke
    Toda, Yuichiro
    Loo, Chu Kiong
    Ishibuchi, Hisao
    Kubota, Naoyuki
    IEEE ACCESS, 2024, 12 : 139692 - 139710
  • [8] Information theoretic clustering
    Gokcay, E
    Principe, JC
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (02) : 158 - 171
  • [9] Adaptive weighted ensemble clustering via kernel learning and local information preservation
    Li, Taiyong
    Shu, Xiaoyang
    Wu, Jiang
    Zheng, Qingxiao
    Lv, Xi
    Xu, Jiaxuan
    KNOWLEDGE-BASED SYSTEMS, 2024, 294
  • [10] Information Theoretic Clustering via Divergence Maximization among Clusters
    Garg, Sahil
    Dalirrooyfard, Mina
    Schneider, Anderson
    Adler, Yeshaya
    Nevmyvaka, Yuriy
    Chen, Yu
    Li, Fengpei
    Cecchi, Guillermo
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 624 - 634