A novel ant-based clustering algorithm using Renyi entropy

被引:21
作者
Zhang, Lei [1 ]
Cao, Qixin [1 ]
Lee, Jay [2 ]
机构
[1] Shanghai Jiao Tong Univ, Res Inst Robot, Shanghai 200240, Peoples R China
[2] Univ Cincinnati, NSF Ctr Intelligent Maintenance Syst, Cincinnati, OH 45221 USA
基金
中国国家自然科学基金;
关键词
Swarm intelligence; Ant-based clustering; Renyi entropy; Kernel; The Friedman test; KERNEL; DENSITY;
D O I
10.1016/j.asoc.2012.11.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ant-based clustering is a type of clustering algorithm that imitates the behavior of ants. To improve the efficiency, increase the adaptability to non-Gaussian datasets and simplify the parameters of the algorithm, a novel ant-based clustering algorithm using Renyi Entropy (NAC-RE) is proposed. There are two aspects to application of Renyi entropy. Firstly, Kernel Entropy Component Analysis (KECA) is applied to modify the random projection of objects when the algorithm is run initially. This projection can create rough clusters and improve the algorithm's efficiency. Secondly, a novel ant movement model governed by Renyi entropy is proposed. The model takes each object as an ant. When the object (ant) moves to a new region, the Renyi entropy in its local neighborhood will be changed. The differential value of entropy governs whether the object should move or be moveless. The new model avoids complex parameters that have influence on the clustering results. The theoretical analysis has been conducted by kernel method to show that Renyi entropy metric is feasible and superior to distance metric. The novel algorithm was compared with other classic ones by several well-known benchmark datasets. The Friedman test with the corresponding Nemenyi test are applied to compare and conclude the algorithms' performance The results indicate that NAC-RE can get better results for non-linearly separable datasets while its parameters are simple. (C) 2012 Elsevier B. V. All rights reserved.
引用
收藏
页码:2643 / 2657
页数:15
相关论文
共 54 条
  • [31] Jolliffe I., 2002, PRINCIPAL COMPONENT, DOI [10.1007/978-1-4757-1904-8_7, 10.1016/0169-7439(87)80084-9]
  • [32] An efficient k-means clustering algorithm:: Analysis and implementation
    Kanungo, T
    Mount, DM
    Netanyahu, NS
    Piatko, CD
    Silverman, R
    Wu, AY
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (07) : 881 - 892
  • [33] Kennedy J., 1995, 1995 IEEE International Conference on Neural Networks Proceedings (Cat. No.95CH35828), P1942, DOI 10.1109/ICNN.1995.488968
  • [34] Kennedy J, 1997, IEEE SYS MAN CYBERN, P4104, DOI 10.1109/ICSMC.1997.637339
  • [35] Clustering web people search results using fuzzy ants
    Lefever, E.
    Fayruzov, T.
    Hoste, V.
    De Cock, M.
    [J]. INFORMATION SCIENCES, 2010, 180 (17) : 3192 - 3209
  • [36] Entropy-Based Metrics in Swarm Clustering
    Liu, Bo
    Pan, Jiuhui
    McKay, R. I.
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2009, 24 (09) : 989 - 1011
  • [37] LUMER ED, 1994, COM ADAP SY, P501
  • [38] Editorial survey: swarm intelligence for data mining
    Martens, David
    Baesens, Bart
    Fawcett, Tom
    [J]. MACHINE LEARNING, 2011, 82 (01) : 1 - 42
  • [39] An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis
    Niknam, Taher
    Amiri, Babak
    [J]. APPLIED SOFT COMPUTING, 2010, 10 (01) : 183 - 197
  • [40] Principe J.C., 2000, UNSUPERVISED ADAPTIV, P1