Research about pruning hyper-parameter optimization method based on transfer learning in geographic information system

被引:0
作者
Zhang X. [1 ]
Li Y. [2 ]
Li Z. [1 ]
机构
[1] School of Modern Post, Beijing University of Posts and Telecommunications, Beijing
[2] School of Economics and Management, Beijing University of Posts and Telecommunications, Beijing
关键词
Automated machine learning algorithm; Geographic information system (GIS); Hyper-parameter optimization; Pruning strategy; SMBO model; Transfer learning;
D O I
10.1007/s12517-021-06465-0
中图分类号
学科分类号
摘要
Recently, researchers have found that some automated optimization methods and techniques can speed up the whole search process and can obtain better model hyper-parameter configurations. In this paper, the optimized initial hyper-parameter configuration is obtained through the loss function defined under the definition of meta-features combined with the algorithm of transfer learning. Furthermore, the sequence model-based hyper-parameter optimization model (SMBO model) is transformed by introducing a pruning strategy. By categorizing the hyper-parameters according to their importance, the non-important hyper-parameters are eliminated but important hyper-parameters are strengthened, so the final hyper-parameter optimization configuration is obtained. It is the parameter optimization design based on this secondary optimization that makes it possible to quickly search and select relevant information and carry out data application. The main goal of this paper is to clarify the mathematical principle of secondary optimization and combine it with geographic information system to create the value development of geographic information database. © 2021, Saudi Society for Geosciences.
引用
收藏
相关论文
共 50 条
[41]   Optimization Method for Sensing Matrix Based on Transfer Learning [J].
Mao Zhaoyang ;
Li Lan ;
Wei Wei .
LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
[42]   Evolutionary Optimization Framework Based on Transfer Learning of Similar Historical Information [J].
Zhang Y. ;
Yang K. ;
Hao G.-S. ;
Gong D.-W. .
Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (03) :652-665
[43]   Optimization method of indoor beam selection based on transfer learning [J].
Wang J. ;
Zhong W. ;
Xiao L. ;
Wang X. ;
Zhu Q. ;
Lin Z. .
Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2024, 46 (03) :1109-1115
[44]   DNN2: A hyper-parameter reinforcement learning game for self-design of neural network based elasto-plastic constitutive descriptions [J].
Fuchs, Alexander ;
Heider, Yousef ;
Wang, Kun ;
Sun, WaiChing ;
Kaliske, Michael .
COMPUTERS & STRUCTURES, 2021, 249
[45]   Research on gesture image recognition method based on transfer learning [J].
Wang, Fei ;
Hu, Ronglin ;
Jin, Ying .
2020 INTERNATIONAL CONFERENCE ON IDENTIFICATION, INFORMATION AND KNOWLEDGE IN THE INTERNET OF THINGS (IIKI2020), 2021, 187 :140-145
[46]   A RESEARCH ON THE METHOD OF CHINESE SENTIMENT ANALYSIS BASED ON TRANSFER LEARNING [J].
Li, Na ;
Tian, Wen-Hong ;
Fu, Rong ;
Zheng, Ting-Ying ;
Zhang, Ting ;
Gu, Xiao-Feng .
2019 16TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICWAMTIP), 2019, :153-156
[47]   Artificial Intelligence based Network Intrusion Detection with hyper-parameter optimization tuning on the realistic cyber dataset CSE-CIC-IDS2018 using cloud computing [J].
Kanimozhi, V ;
Jacob, T. Prem .
ICT EXPRESS, 2019, 5 (03) :211-214
[48]   Research on Intrusion Detection System Based on Integrated Transfer Learning [J].
Hu, Jian ;
Zhou, Jing ;
Su, Yongdong ;
Xiao, Peng ;
Wang, Hailin .
2020 5TH INTERNATIONAL CONFERENCE ON SMART GRID AND ELECTRICAL AUTOMATION (ICSGEA 2020), 2020, :300-305
[49]   Hyper-parameter optimization of deep learning architectures using artificial bee colony (ABC) algorithm for high performance real-time automatic colorectal cancer (CRC) polyp detection [J].
Ahmet Karaman ;
Dervis Karaboga ;
Ishak Pacal ;
Bahriye Akay ;
Alper Basturk ;
Ufuk Nalbantoglu ;
Seymanur Coskun ;
Omur Sahin .
Applied Intelligence, 2023, 53 :15603-15620
[50]   A Long-Term Prediction Method of Computer Parameter Degradation Based on Curriculum Learning and Transfer Learning [J].
Mao, Yuanhong ;
Ma, Zhong ;
Liu, Xi ;
He, Pengchao ;
Chai, Bo .
MATHEMATICS, 2023, 11 (14)