Fuzzy c-Means Clustering in Persistence Diagram Space for Deep Learning Model Selection

被引:0
作者
Davies, Thomas [1 ]
Aspinall, Jack [2 ]
Wilder, Bryan [3 ]
Tran-Thanh, Long [4 ]
机构
[1] Univ Southampton, Southampton, Hants, England
[2] Univ Oxford, Oxford, England
[3] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
[4] Univ Warwick, Coventry, W Midlands, England
来源
NEURIPS WORKSHOP ON SYMMETRY AND GEOMETRY IN NEURAL REPRESENTATIONS, VOL 197 | 2022年 / 197卷
关键词
Topological Data Analysis; Fuzzy Clustering; Model Selection; TOPOLOGICAL DATA-ANALYSIS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Persistence diagrams concisely capture the structure of data, an ability that is increasingly being used in the nascent field of topological machine learning. We extend the ubiquitous Fuzzy c-Means (FCM) clustering algorithm to the space of persistence diagrams, enabling unsupervised learning in a topological setting. We give theoretical convergence guarantees that correspond to the Euclidean case and empirically demonstrate the capability of the clustering to capture topological information via the fuzzy RAND index. We present an application of our algorithm to a scenario that utilises both the topological and fuzzy nature of our algorithm: pre-trained model selection in deep learning. As pre-trained models can perform well on multiple tasks, selecting the best model is a naturally fuzzy problem; we show that fuzzy clustering persistence diagrams allows for unsupervised model selection using just the topology of their decision boundaries.
引用
收藏
页码:137 / 157
页数:21
相关论文
共 55 条
[1]  
[Anonymous], 1969, Prentice-Hall international series in management
[2]  
[Anonymous], 2016, The Structure and Stability of Persistence Modules, DOI DOI 10.1007/978-3-319-42545-0
[3]   ITERATIVE BREGMAN PROJECTIONS FOR REGULARIZED TRANSPORTATION PROBLEMS [J].
Benamou, Jean-David ;
Carlier, Guillaume ;
Cuturi, Marco ;
Nenna, Luca ;
Peyre, Gabriel .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (02) :A1111-A1138
[4]   CONVERGENCE THEORY FOR FUZZY C-MEANS - COUNTEREXAMPLES AND REPAIRS [J].
BEZDEK, JC ;
HATHAWAY, RJ ;
SABIN, MJ ;
TUCKER, WT .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1987, 17 (05) :873-877
[6]  
Brüel-Gabrielsson R, 2020, PR MACH LEARN RES, V108, P1553
[7]  
Bubenik P, 2020, Arxiv, DOI arXiv:1905.05604
[8]  
Bubenik P, 2015, J MACH LEARN RES, V16, P77
[9]   A fuzzy extension of the Rand index and other related indexes for clustering and classification assessment [J].
Campello, R. J. G. B. .
PATTERN RECOGNITION LETTERS, 2007, 28 (07) :833-841
[10]  
Carrière M, 2020, PR MACH LEARN RES, V108, P2786