Research about pruning hyper-parameter optimization method based on transfer learning in geographic information system

被引:0
|
作者
Zhang X. [1 ]
Li Y. [2 ]
Li Z. [1 ]
机构
[1] School of Modern Post, Beijing University of Posts and Telecommunications, Beijing
[2] School of Economics and Management, Beijing University of Posts and Telecommunications, Beijing
关键词
Automated machine learning algorithm; Geographic information system (GIS); Hyper-parameter optimization; Pruning strategy; SMBO model; Transfer learning;
D O I
10.1007/s12517-021-06465-0
中图分类号
学科分类号
摘要
Recently, researchers have found that some automated optimization methods and techniques can speed up the whole search process and can obtain better model hyper-parameter configurations. In this paper, the optimized initial hyper-parameter configuration is obtained through the loss function defined under the definition of meta-features combined with the algorithm of transfer learning. Furthermore, the sequence model-based hyper-parameter optimization model (SMBO model) is transformed by introducing a pruning strategy. By categorizing the hyper-parameters according to their importance, the non-important hyper-parameters are eliminated but important hyper-parameters are strengthened, so the final hyper-parameter optimization configuration is obtained. It is the parameter optimization design based on this secondary optimization that makes it possible to quickly search and select relevant information and carry out data application. The main goal of this paper is to clarify the mathematical principle of secondary optimization and combine it with geographic information system to create the value development of geographic information database. © 2021, Saudi Society for Geosciences.
引用
收藏
相关论文
共 50 条
  • [1] An efficient hyper-parameter optimization method for supervised learning
    Shi, Ying
    Qi, Hui
    Qi, Xiaobo
    Mu, Xiaofang
    APPLIED SOFT COMPUTING, 2022, 126
  • [2] Federated learning with hyper-parameter optimization
    Kundroo, Majid
    Kim, Taehong
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (09)
  • [3] A new hyper-parameter optimization method for machine learning in fault classification
    Ye, Xingchen
    Gao, Liang
    Li, Xinyu
    Wen, Long
    APPLIED INTELLIGENCE, 2023, 53 (11) : 14182 - 14200
  • [4] A new hyper-parameter optimization method for machine learning in fault classification
    Xingchen Ye
    Liang Gao
    Xinyu Li
    Long Wen
    Applied Intelligence, 2023, 53 : 14182 - 14200
  • [5] A lightweight intrusion detection system for internet of vehicles based on transfer learning and MobileNetV2 with hyper-parameter optimization
    Yingqing Wang
    Guihe Qin
    Mi Zou
    Yanhua Liang
    Guofeng Wang
    Kunpeng Wang
    Yao Feng
    Zizhan Zhang
    Multimedia Tools and Applications, 2024, 83 : 22347 - 22369
  • [6] A lightweight intrusion detection system for internet of vehicles based on transfer learning and MobileNetV2 with hyper-parameter optimization
    Wang, Yingqing
    Qin, Guihe
    Zou, Mi
    Liang, Yanhua
    Wang, Guofeng
    Wang, Kunpeng
    Feng, Yao
    Zhang, Zizhan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (8) : 22347 - 22369
  • [7] Deep Learning Hyper-Parameter Optimization for Video Analytics in Clouds
    Yaseen, Muhammad Usman
    Anjum, Ashiq
    Rana, Omer
    Antonopoulos, Nikolaos
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (01): : 253 - 264
  • [8] Automatic CNN Compression Based on Hyper-parameter Learning
    Tian, Nannan
    Liu, Yong
    Wang, Weiping
    Meng, Dan
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] The Tabu_Genetic Algorithm: A Novel Method for Hyper-Parameter Optimization of Learning Algorithms
    Guo, Baosu
    Hu, Jingwen
    Wu, Wenwen
    Peng, Qingjin
    Wu, Fenghe
    ELECTRONICS, 2019, 8 (05)
  • [10] Research on Hyper-Parameter Optimization of Activity Recognition Algorithm Based on Improved Cuckoo Search
    Tong, Yu
    Yu, Bo
    ENTROPY, 2022, 24 (06)