Research about pruning hyper-parameter optimization method based on transfer learning in geographic information system

被引:0
作者
Zhang X. [1 ]
Li Y. [2 ]
Li Z. [1 ]
机构
[1] School of Modern Post, Beijing University of Posts and Telecommunications, Beijing
[2] School of Economics and Management, Beijing University of Posts and Telecommunications, Beijing
关键词
Automated machine learning algorithm; Geographic information system (GIS); Hyper-parameter optimization; Pruning strategy; SMBO model; Transfer learning;
D O I
10.1007/s12517-021-06465-0
中图分类号
学科分类号
摘要
Recently, researchers have found that some automated optimization methods and techniques can speed up the whole search process and can obtain better model hyper-parameter configurations. In this paper, the optimized initial hyper-parameter configuration is obtained through the loss function defined under the definition of meta-features combined with the algorithm of transfer learning. Furthermore, the sequence model-based hyper-parameter optimization model (SMBO model) is transformed by introducing a pruning strategy. By categorizing the hyper-parameters according to their importance, the non-important hyper-parameters are eliminated but important hyper-parameters are strengthened, so the final hyper-parameter optimization configuration is obtained. It is the parameter optimization design based on this secondary optimization that makes it possible to quickly search and select relevant information and carry out data application. The main goal of this paper is to clarify the mathematical principle of secondary optimization and combine it with geographic information system to create the value development of geographic information database. © 2021, Saudi Society for Geosciences.
引用
收藏
相关论文
共 50 条
  • [21] Speeding up Hyper-parameter Optimization by Extrapolation of Learning Curves Using Previous Builds
    Chandrashekaran, Akshay
    Lane, Ian R.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 : 477 - 492
  • [22] Native Support for Federated Learning Hyper-Parameter Optimization in 6G Networks
    Khan, Mohammad Bariq
    An, Xueli
    Dressler, Falko
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [23] Application of a Stochastic Schemata Exploiter for Multi-Objective Hyper-parameter Optimization of Machine Learning
    Makino, Hiroya
    Kita, Eisuke
    REVIEW OF SOCIONETWORK STRATEGIES, 2023, 17 (02) : 179 - 213
  • [24] Application of a Stochastic Schemata Exploiter for Multi-Objective Hyper-parameter Optimization of Machine Learning
    Hiroya Makino
    Eisuke Kita
    The Review of Socionetwork Strategies, 2023, 17 : 179 - 213
  • [25] HYPER-PARAMETER OPTIMIZATION OF DEEP LEARNING MODELS FOR COMPRESSOR AIR LEAK PREDICTION IN A GAS TURBINE
    Nogueras-Rivera, Diego I.
    Mojica-Vazquez, Lemuel
    Bonilla-Alvarado, Harry
    Bryden, Kenneth M.
    Tucker, David
    Traverso-Aviles, Luis M.
    Aponte-Roa, Diego A.
    PROCEEDINGS OF THE ASME 2022 POWER CONFERENCE, POWER2022, 2022,
  • [26] Surrogate network-based sparseness hyper-parameter optimization for deep expression recognition
    Xie, Weicheng
    Chen, Wenting
    Shen, Linlin
    Duan, Jinming
    Yang, Meng
    PATTERN RECOGNITION, 2021, 111
  • [27] Hyper-parameter optimization of multiple machine learning algorithms for molecular property prediction using hyperopt library
    Zhang, Jun
    Wang, Qin
    Shen, Weifeng
    CHINESE JOURNAL OF CHEMICAL ENGINEERING, 2022, 52 : 115 - 125
  • [28] Hyper-Parameter Optimization by Using the Genetic Algorithm for Upper Limb Activities Recognition Based on Neural Networks
    Zhang, Junjie
    Sun, Guangmin
    Sun, Yuge
    Dou, Huijing
    Bilal, Anas
    IEEE SENSORS JOURNAL, 2021, 21 (02) : 1877 - 1884
  • [29] Intent Detection-Based Lithuanian Chatbot Created via Automatic DNN Hyper-Parameter Optimization
    Kapociute-Dzikiene, Jurgita
    HUMAN LANGUAGE TECHNOLOGIES - THE BALTIC PERSPECTIVE (HLT 2020), 2020, 328 : 95 - 102
  • [30] A recommendation model for optimizing transfer learning hyper-parameter settings in building heat load prediction with limited data samples
    Bai, Di
    Ma, Shuo
    Yang, Xiaochen
    Ma, Dandan
    Ma, Xiaoyu
    Ma, Hongting
    ENERGY AND BUILDINGS, 2024, 325