Membership Affinity Lasso for Fuzzy Clustering

被引:40
作者
Guo, Li [1 ]
Chen, Long [1 ]
Lu, Xiliang [2 ,3 ]
Chen, C. L. Philip [1 ]
机构
[1] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
[2] Wuhan Univ, Sch Math & Stat, Wuhan 430072, Peoples R China
[3] Wuhan Univ, Hubei Key Lab Computat Sci, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Clustering algorithms; Clustering methods; Optimization; Linear programming; Convex functions; Kernel; Convergence; Alternating direction method of multiplier (ADMM); fuzzy clustering; membership affinity lasso (MAL); prior knowledge; C-MEANS; GRAPH; REGULARIZATION; CLASSIFICATION; INFORMATION;
D O I
10.1109/TFUZZ.2019.2905114
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fuzzy clustering generates a membership vector for each data point in the dataset to indicate its belongingness to different clusters. This procedure can be regarded as an encoding process and the obtained vectors of memberships are the new representations of original data. Naturally, the affinities between new representations or the vectors of memberships should be consistent with the ones between original data points. For example, the data points close to each other should also take similar membership vectors. Such constraints on the affinities of memberships are valuable prior knowledge that should be imposed to the objective function of fuzzy clustering for better performance. To this end, we introduce the membership affinity lasso for fuzzy clustering in this paper. Utilizing alternating direction method of multipliers, an efficient approach is derived to optimize the general membership affinity lasso regularized fuzzy clustering model in offline manner. As illustrative examples, three new fuzzy clustering algorithms with the membership affinity lasso are proposed. Experiments on the synthetic and real data demonstrate the superiority and flexibility of the proposed algorithms.
引用
收藏
页码:294 / 307
页数:14
相关论文
共 62 条
[1]   Modified Gath-Geva fuzzy clustering for identification of Takagi-Sugeno fuzzy models [J].
Abonyi, J ;
Babuska, R ;
Szeifert, F .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2002, 32 (05) :612-621
[2]  
[Anonymous], 2008, CLUSTERING
[3]  
[Anonymous], 2009, MATCHING THEORY
[4]  
[Anonymous], [No title captured]
[5]   An overview of fuzzy modeling for control [J].
Babuska, R ;
Verbruggen, HB .
CONTROL ENGINEERING PRACTICE, 1996, 4 (11) :1593-1606
[6]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[7]  
Bertsekas D. P., 1999, Nonlinear Programming
[8]  
Bezdek J.C., 2006, Fuzzy models and algorithms for pattern recognition and image processing, V4
[9]   FCM - THE FUZZY C-MEANS CLUSTERING-ALGORITHM [J].
BEZDEK, JC ;
EHRLICH, R ;
FULL, W .
COMPUTERS & GEOSCIENCES, 1984, 10 (2-3) :191-203
[10]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122