Domain Adaptation Multitask Optimization

被引:19
|
作者
Wang, Xiaoling [1 ]
Kang, Qi [1 ]
Zhou, MengChu [2 ,3 ]
Yao, Siya [1 ]
Abusorrah, Abdullah [4 ,5 ]
机构
[1] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi Arabia
[4] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] King Abdulaziz Univ, KA CARE Energy Res & Innovat Ctr, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Domain adaptation; evolutionary algorithm (EA); knowledge transfer; machine learning; multitask optimization (MTO); DIFFERENTIAL EVOLUTION; ALGORITHM;
D O I
10.1109/TCYB.2022.3222101
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multitask optimization (MTO) is a new optimization paradigm that leverages useful information contained in multiple tasks to help solve each other. It attracts increasing attention in recent years and gains significant performance improvements. However, the solutions of distinct tasks usually obey different distributions. To avoid that individuals after intertask learning are not suitable for the original task due to the distribution differences and even impede overall solution efficiency, we propose a novel multitask evolutionary framework that enables knowledge aggregation and online learning among distinct tasks to solve MTO problems. Our proposal designs a domain adaptation-based mapping strategy to reduce the difference across solution domains and find more genetic traits to improve the effectiveness of information interactions. To further improve the algorithm performance, we propose a smart way to divide initial population into different subpopulations and choose suitable individuals to learn. By ranking individuals in target subpopulation, worse-performing individuals can learn from other tasks. The significant advantage of our proposed paradigm over the state of the art is verified via a series of MTO benchmark studies.
引用
收藏
页码:4567 / 4578
页数:12
相关论文
共 50 条
  • [21] Neural Network-Based Knowledge Transfer for Multitask Optimization
    Xue, Zhao-Feng
    Wang, Zi-Jia
    Zhan, Zhi-Hui
    Kwong, Sam
    Zhang, Jun
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (12) : 7541 - 7554
  • [22] Interpretable domain adaptation via optimization over the Stiefel manifold
    Poelitz, Christian
    Duivesteijn, Wouter
    Morik, Katharina
    MACHINE LEARNING, 2016, 104 (2-3) : 315 - 336
  • [23] Non-linear Domain Adaptation in Transfer Evolutionary Optimization
    Lim, Ray
    Gupta, Abhishek
    Ong, Yew-Soon
    Feng, Liang
    Zhang, Allan N.
    COGNITIVE COMPUTATION, 2021, 13 (02) : 290 - 307
  • [24] Non-linear Domain Adaptation in Transfer Evolutionary Optimization
    Ray Lim
    Abhishek Gupta
    Yew-Soon Ong
    Liang Feng
    Allan N. Zhang
    Cognitive Computation, 2021, 13 : 290 - 307
  • [25] Interpretable domain adaptation via optimization over the Stiefel manifold
    Christian Pölitz
    Wouter Duivesteijn
    Katharina Morik
    Machine Learning, 2016, 104 : 315 - 336
  • [26] Deep Discriminative Domain Adaptation
    Zhang, Changchun
    Zhao, Qingjie
    INFORMATION SCIENCES, 2021, 575 : 599 - 610
  • [27] Domain Adaptation for Microscopy Imaging
    Becker, Carlos
    Christoudias, C. Mario
    Fua, Pascal
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2015, 34 (05) : 1125 - 1139
  • [28] Quantum classifiers for domain adaptation
    Xi He
    Feiyu Du
    Mingyuan Xue
    Xiaogang Du
    Tao Lei
    A. K. Nandi
    Quantum Information Processing, 22
  • [29] Quantum classifiers for domain adaptation
    He, Xi
    Du, Feiyu
    Xue, Mingyuan
    Du, Xiaogang
    Lei, Tao
    Nandi, A. K.
    QUANTUM INFORMATION PROCESSING, 2023, 22 (02)
  • [30] ITERATIVE RE-WEIGHTED INSTANCE TRANSFER FOR DOMAIN ADAPTATION
    Paul, A.
    Rottensteiner, F.
    Heipke, C.
    XXIII ISPRS CONGRESS, COMMISSION III, 2016, 3 (03): : 339 - 346