Research about pruning hyper-parameter optimization method based on transfer learning in geographic information system

被引:0
作者
Zhang X. [1 ]
Li Y. [2 ]
Li Z. [1 ]
机构
[1] School of Modern Post, Beijing University of Posts and Telecommunications, Beijing
[2] School of Economics and Management, Beijing University of Posts and Telecommunications, Beijing
关键词
Automated machine learning algorithm; Geographic information system (GIS); Hyper-parameter optimization; Pruning strategy; SMBO model; Transfer learning;
D O I
10.1007/s12517-021-06465-0
中图分类号
学科分类号
摘要
Recently, researchers have found that some automated optimization methods and techniques can speed up the whole search process and can obtain better model hyper-parameter configurations. In this paper, the optimized initial hyper-parameter configuration is obtained through the loss function defined under the definition of meta-features combined with the algorithm of transfer learning. Furthermore, the sequence model-based hyper-parameter optimization model (SMBO model) is transformed by introducing a pruning strategy. By categorizing the hyper-parameters according to their importance, the non-important hyper-parameters are eliminated but important hyper-parameters are strengthened, so the final hyper-parameter optimization configuration is obtained. It is the parameter optimization design based on this secondary optimization that makes it possible to quickly search and select relevant information and carry out data application. The main goal of this paper is to clarify the mathematical principle of secondary optimization and combine it with geographic information system to create the value development of geographic information database. © 2021, Saudi Society for Geosciences.
引用
收藏
相关论文
共 50 条
[31]   A recommendation model for optimizing transfer learning hyper-parameter settings in building heat load prediction with limited data samples [J].
Bai, Di ;
Ma, Shuo ;
Yang, Xiaochen ;
Ma, Dandan ;
Ma, Xiaoyu ;
Ma, Hongting .
ENERGY AND BUILDINGS, 2024, 325
[32]   Multi-task learning for pre-processing of printed Devanagari document images with hyper-parameter optimization of the deep architecture using Taguchi method [J].
Akhter, Shaheera Saba Mohd Naseem ;
Rege, Priti P. .
SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 2021, 46 (03)
[33]   Multi-task learning for pre-processing of printed Devanagari document images with hyper-parameter optimization of the deep architecture using Taguchi method [J].
Shaheera Saba Mohd Naseem Akhter ;
Priti P Rege .
Sādhanā, 2021, 46
[34]   Designing a grey wolf optimization based hyper-parameter optimized convolutional neural network classifier for skin cancer detection [J].
Mohakud, Rasmiranjan ;
Dash, Rajashree .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (08) :6280-6291
[35]   Hyper-parameter optimization based nonlinear multistate deterioration modeling for deterioration level assessment and remaining useful life prognostics [J].
Chen, Gaige ;
Chen, Jinglong ;
Zi, Yanyang ;
Miao, Huihui .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2017, 167 :517-526
[36]   Bayesian Network Parameter Learning Method Based on Transfer Learning [J].
Wang S. ;
Guan Z.-X. ;
Wang J. ;
Sun X.-H. .
Dongbei Daxue Xuebao/Journal of Northeastern University, 2021, 42 (04) :509-515
[37]   Model NOx, SO2 Emissions Concentration and Thermal Efficiency of CFBB Based on a Hyper-Parameter Self-Optimized Broad Learning System [J].
Ma, Yunpeng ;
Xu, Chenheng ;
Wang, Hua ;
Wang, Ran ;
Liu, Shilin ;
Gu, Xiaoying .
ENERGIES, 2022, 15 (20)
[38]   Annealing of Monel 400 Alloy Using Principal Component Analysis, Hyper-parameter Optimization, Machine Learning Techniques, and Multi-objective Particle Swarm Optimization [J].
Chintakindi, Sanjay ;
Alsamhan, Ali ;
Abidi, Mustufa Haider ;
Kumar, Maduri Praveen .
INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2022, 15 (01)
[39]   Incremental-based YoloV3 model with hyper-parameter optimization for product image classification in E-commerce sector [J].
Dutta, Munmi ;
Ganguly, Amrita .
APPLIED SOFT COMPUTING, 2024, 165
[40]   Research on Fault Prediction Method of Elevator Door System Based on Transfer Learning [J].
Pan, Jun ;
Shao, Changxu ;
Dai, Yuefang ;
Wei, Yimin ;
Chen, Wenhua ;
Lin, Zheng .
SENSORS, 2024, 24 (07)