Automatic Configuration of Kernel-Based Clustering: An Optimization Approach

被引:9
作者
Candelieri, Antonio [1 ]
Giordani, Ilaria [1 ]
Archetti, Francesco [1 ,2 ]
机构
[1] Univ Milano Bicocca, Dipartimento Informat Sistemist & Comunicaz, DISCo, I-20126 Milan, Italy
[2] Consorzio Milano Ric, Via R Cozzi 53, I-20125 Milan, Italy
来源
LEARNING AND INTELLIGENT OPTIMIZATION (LION 11 2017) | 2017年 / 10556卷
关键词
Hyperparameters optimization; Sequential model based optimization; Kernel based clustering; Leakage localization; WATER DISTRIBUTION NETWORKS; GLOBAL OPTIMIZATION; LOCALIZATION;
D O I
10.1007/978-3-319-69404-7_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper generalizes a method originally developed by the authors to perform data driven localization of leakages in urban Water Distribution Networks. The method is based on clustering to perform exploratory analysis and a pool of Support Vector Machines to process on line sensors readings. The performance depends on certain hyperparameters which have been considered as decision variables in a sequential model based optimization process. The objective function is related to clustering performance, computed through an external validity index defined according to the leakage localization goal. Thus, as usual in hyperparameters tuning of machine learning algorithms, the objective function is black box. In this paper it is shown how a Bayesian framework offers not only a good performance but also the flexibility to consider in the optimization loop also the automatic configuration of the algorithm. Both Gaussian Processes and Random Forests have been considered to fit the surrogate model of the objective function, while results from a simple grid search have been considered as baseline.
引用
收藏
页码:34 / 49
页数:16
相关论文
共 47 条
[1]  
[Anonymous], 2010, A tutorial on Bayesian optimization of expensive cost functions
[2]  
[Anonymous], 2015, NIPS
[3]  
[Anonymous], 2016, ARXIV160306560
[4]  
[Anonymous], 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI)
[5]  
[Anonymous], 2012, P 25 INT C NEURIPS
[6]  
[Anonymous], ADV NEURAL INF PROCE
[7]   An extensive comparative study of cluster validity indices [J].
Arbelaitz, Olatz ;
Gurrutxaga, Ibai ;
Muguerza, Javier ;
Perez, Jesus M. ;
Perona, Inigo .
PATTERN RECOGNITION, 2013, 46 (01) :243-256
[8]  
Bagnall A., 2017, ARXIV170306777V1CSLG
[9]  
Barkalov K, 2013, LECT NOTES COMPUT SC, V7979, P154, DOI 10.1007/978-3-642-39958-9_14
[10]  
Bischl B., 2017, mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions