A Deep Neural Networks Based on Multi-task Learning and Its Application

被引:0
作者
Zhao, Mengru [1 ]
Zhang, Yuxian [2 ]
Qiao, Likui [2 ]
Sun, Deyuan [3 ]
机构
[1] Shenyang Univ Technol, Sch Artificial Intelligence, Shenyang 110870, Liaoning, Peoples R China
[2] Shenyang Univ Technol, Sch Elect Engn, Shenyang 110870, Liaoning, Peoples R China
[3] Neusoft Med Syst Co Ltd, Shenyang 110167, Peoples R China
来源
2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC) | 2021年
基金
中国国家自然科学基金;
关键词
Multi-task learning; Deep neural networks; Wind turbine generator; Normal behavior model; Demographic prediction;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of machine learning, the deep neural network has achieved excellent performance. However, the learning of deep neural network often needs a large number of data and the independent learning of a single task tends to ignore the information from other tasks, resulting in redundant training and the cost of learning resources. In order to solve these problems, we introduce the deep neural network based on multi-task learning model. We introduce the structure of the multi-tasking learning model in detail, and use demographic information to prove the effectiveness of the model. Finally deep neural network based on multi-task learning framework is adapted to builds a normal behavior model for wind turbine generator in which each subspace of operating condition are taken as a task. The operating data comes from Liaoning wind farm in northeast China are used to verify the proposed method. The results indicate the subspace division of different operating condition benefits to improve the accuracy of normal behavior model of wind turbine generator, and multi-task learning is suitable to deal with the integrate subspace model.
引用
收藏
页码:6201 / 6206
页数:6
相关论文
共 14 条
[1]  
AVH,DASB, 2020, KNOWL-BASED SYST, P209
[2]   A Bayesian information theoretic model of learning to learn via multiple task sampling [J].
Baxter, J .
MACHINE LEARNING, 1997, 28 (01) :7-39
[3]   Multitask learning [J].
Caruana, R .
MACHINE LEARNING, 1997, 28 (01) :41-75
[4]  
Crawshaw M, ARXIV 2020 ARXIV2009
[5]   Multi-task learning for the prediction of wind power ramp events with deep neural networks [J].
Dorado-Moreno, M. ;
Navarin, N. ;
Gutierrez, P. A. ;
Prieto, L. ;
Sperduti, A. ;
Salcedo-Sanz, S. ;
Hervas-Martinez, C. .
NEURAL NETWORKS, 2020, 123 :401-411
[6]   A working guide to boosted regression trees [J].
Elith, J. ;
Leathwick, J. R. ;
Hastie, T. .
JOURNAL OF ANIMAL ECOLOGY, 2008, 77 (04) :802-813
[7]  
Kim R, 2019, MACHINE LEARNING
[8]  
Liu P, 2016, P 25 INT JOINT C ART, P2873
[9]   End-to-End Multi-Task Learning with Attention [J].
Liu, Shikun ;
Johns, Edward ;
Davison, Andrew J. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1871-1880
[10]  
Maurer A, 2016, J MACH LEARN RES, V17