Research about pruning hyper-parameter optimization method based on transfer learning in geographic information system

被引:0
作者
Zhang X. [1 ]
Li Y. [2 ]
Li Z. [1 ]
机构
[1] School of Modern Post, Beijing University of Posts and Telecommunications, Beijing
[2] School of Economics and Management, Beijing University of Posts and Telecommunications, Beijing
关键词
Automated machine learning algorithm; Geographic information system (GIS); Hyper-parameter optimization; Pruning strategy; SMBO model; Transfer learning;
D O I
10.1007/s12517-021-06465-0
中图分类号
学科分类号
摘要
Recently, researchers have found that some automated optimization methods and techniques can speed up the whole search process and can obtain better model hyper-parameter configurations. In this paper, the optimized initial hyper-parameter configuration is obtained through the loss function defined under the definition of meta-features combined with the algorithm of transfer learning. Furthermore, the sequence model-based hyper-parameter optimization model (SMBO model) is transformed by introducing a pruning strategy. By categorizing the hyper-parameters according to their importance, the non-important hyper-parameters are eliminated but important hyper-parameters are strengthened, so the final hyper-parameter optimization configuration is obtained. It is the parameter optimization design based on this secondary optimization that makes it possible to quickly search and select relevant information and carry out data application. The main goal of this paper is to clarify the mathematical principle of secondary optimization and combine it with geographic information system to create the value development of geographic information database. © 2021, Saudi Society for Geosciences.
引用
收藏
相关论文
共 50 条
[21]   Speeding up Hyper-parameter Optimization by Extrapolation of Learning Curves Using Previous Builds [J].
Chandrashekaran, Akshay ;
Lane, Ian R. .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 :477-492
[22]   Native Support for Federated Learning Hyper-Parameter Optimization in 6G Networks [J].
Khan, Mohammad Bariq ;
An, Xueli ;
Dressler, Falko .
2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
[23]   Application of a Stochastic Schemata Exploiter for Multi-Objective Hyper-parameter Optimization of Machine Learning [J].
Makino, Hiroya ;
Kita, Eisuke .
REVIEW OF SOCIONETWORK STRATEGIES, 2023, 17 (02) :179-213
[24]   Application of a Stochastic Schemata Exploiter for Multi-Objective Hyper-parameter Optimization of Machine Learning [J].
Hiroya Makino ;
Eisuke Kita .
The Review of Socionetwork Strategies, 2023, 17 :179-213
[25]   HYPER-PARAMETER OPTIMIZATION OF DEEP LEARNING MODELS FOR COMPRESSOR AIR LEAK PREDICTION IN A GAS TURBINE [J].
Nogueras-Rivera, Diego I. ;
Mojica-Vazquez, Lemuel ;
Bonilla-Alvarado, Harry ;
Bryden, Kenneth M. ;
Tucker, David ;
Traverso-Aviles, Luis M. ;
Aponte-Roa, Diego A. .
PROCEEDINGS OF THE ASME 2022 POWER CONFERENCE, POWER2022, 2022,
[26]   Surrogate network-based sparseness hyper-parameter optimization for deep expression recognition [J].
Xie, Weicheng ;
Chen, Wenting ;
Shen, Linlin ;
Duan, Jinming ;
Yang, Meng .
PATTERN RECOGNITION, 2021, 111
[27]   Hyper-parameter Optimization of Regularized-Extreme Learning Machine Using a Modified Opposition-Based Learning Artificial Bee Colony [J].
Vasquez-Iglesias, Philip ;
Pizarro, Amelia E. ;
Zabala-Blanco, David ;
Fuentes-Concha, Juan ;
Ahumada-Garcia, Roberto ;
Gonzalez, Paulo .
2024 43RD INTERNATIONAL CONFERENCE OF THE CHILEAN COMPUTER SCIENCE SOCIETY, SCCC, 2024,
[28]   Hyper-parameter optimization of multiple machine learning algorithms for molecular property prediction using hyperopt library [J].
Zhang, Jun ;
Wang, Qin ;
Shen, Weifeng .
CHINESE JOURNAL OF CHEMICAL ENGINEERING, 2022, 52 :115-125
[29]   Hyper-Parameter Optimization by Using the Genetic Algorithm for Upper Limb Activities Recognition Based on Neural Networks [J].
Zhang, Junjie ;
Sun, Guangmin ;
Sun, Yuge ;
Dou, Huijing ;
Bilal, Anas .
IEEE SENSORS JOURNAL, 2021, 21 (02) :1877-1884
[30]   Intent Detection-Based Lithuanian Chatbot Created via Automatic DNN Hyper-Parameter Optimization [J].
Kapociute-Dzikiene, Jurgita .
HUMAN LANGUAGE TECHNOLOGIES - THE BALTIC PERSPECTIVE (HLT 2020), 2020, 328 :95-102