Feature-weighted clustering with inner product induced norm based dissimilarity measures: an optimization perspective

被引:0
作者
Arkajyoti Saha
Swagatam Das
机构
[1] Indian Statistical Institute,Stat
[2] Indian Statistical Institute,Math Unit
来源
Machine Learning | 2017年 / 106卷
关键词
Dissimilarity measures; Inner product induced norm; Hard and fuzzy clustering; Generalized feature weighting; Feature selection; Convergence analysis;
D O I
暂无
中图分类号
学科分类号
摘要
The performance of a clustering algorithm can be improved by assigning appropriate weights to different features of the data. Such feature weighting is likely to reduce the effect of noise and irrelevant features while enhancing the effect of the discriminative features simultaneously. For the clustering purpose, feature-weighted dissimilarity measures are so far limited to Euclidean, Mahalanobis, and exponential distances. In this article, we introduce a novel feature weighting scheme for the general class of inner product induced norm (IPIN) based weighted dissimilarity measures. This class has a wide range and includes the three above-mentioned distances as special cases. We develop the general algorithms to solve the hard (k-means) and fuzzy (fuzzy c-means) partitional clustering problems and undertake in-depth analyses of the convergence of the algorithms as well. In addition, we address issues like feasibility and uniqueness of the solutions of these problems in sufficient details. The novelty of the article lies in the introduction of a general feature weighting scheme for the generalized class of IPIN-based dissimilarity measures and a complete convergence analysis for the automated feature-weighted clustering algorithms using such measures.
引用
收藏
页码:951 / 992
页数:41
相关论文
共 62 条
[1]  
Bandyopadhyay S(2002)Genetic clustering for automatic evolution of clusters and application to image classification Pattern Recognition 35 1197-1208
[2]  
Maulik U(2005)Clustering with Bregman divergences The Journal of Machine Learning Research 6 1705-1749
[3]  
Banerjee A(1973)Cluster validity with fuzzy sets Journal of Cybernetics 3 58-73
[4]  
Merugu S(2003)Convergence of alternating optimization Neural, Parallel & Scientific Computations 11 351-368
[5]  
Dhillon IS(2015)Analysis of parameter selection for Gustafson-Kessel fuzzy clustering using Jacobian matrix IEEE Transactions on Fuzzy Systems 23 2329-2342
[6]  
Ghosh J(1996)Validating fuzzy partitions obtained through c-shells clustering Pattern Recognition Letters 17 613-623
[7]  
Bezdek JC(1988)OVWTRE: A program for optimal variable weighting for ultrametric and additive tree fitting Journal of Classification 5 101-104
[8]  
Bezdek JC(1984)Synthesized clustering: A method for amalgamating alternative clustering bases with differential weighting of variables Psychometrika 49 57-78
[9]  
Hathaway RJ(1973)A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters Journal of Cybernetics 3 32-57
[10]  
Chaomurilige YJ(1989)Unsupervised optimal fuzzy clustering IEEE Transactions on Pattern Analysis and Machine Intelligence 11 773-780