Domain Adaptation Multitask Optimization

被引:19
|
作者
Wang, Xiaoling [1 ]
Kang, Qi [1 ]
Zhou, MengChu [2 ,3 ]
Yao, Siya [1 ]
Abusorrah, Abdullah [4 ,5 ]
机构
[1] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Jeddah 21589, Saudi Arabia
[4] King Abdulaziz Univ, Ctr Res Excellence Renewable Energy & Power Syst, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] King Abdulaziz Univ, KA CARE Energy Res & Innovat Ctr, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Domain adaptation; evolutionary algorithm (EA); knowledge transfer; machine learning; multitask optimization (MTO); DIFFERENTIAL EVOLUTION; ALGORITHM;
D O I
10.1109/TCYB.2022.3222101
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multitask optimization (MTO) is a new optimization paradigm that leverages useful information contained in multiple tasks to help solve each other. It attracts increasing attention in recent years and gains significant performance improvements. However, the solutions of distinct tasks usually obey different distributions. To avoid that individuals after intertask learning are not suitable for the original task due to the distribution differences and even impede overall solution efficiency, we propose a novel multitask evolutionary framework that enables knowledge aggregation and online learning among distinct tasks to solve MTO problems. Our proposal designs a domain adaptation-based mapping strategy to reduce the difference across solution domains and find more genetic traits to improve the effectiveness of information interactions. To further improve the algorithm performance, we propose a smart way to divide initial population into different subpopulations and choose suitable individuals to learn. By ranking individuals in target subpopulation, worse-performing individuals can learn from other tasks. The significant advantage of our proposed paradigm over the state of the art is verified via a series of MTO benchmark studies.
引用
收藏
页码:4567 / 4578
页数:12
相关论文
共 50 条
  • [31] Regularized Evolutionary Multitask Optimization: Learning to Intertask Transfer in Aligned Subspace
    Tang, Zedong
    Gong, Maoguo
    Wu, Yue
    Liu, Wenfeng
    Xie, Yu
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2021, 25 (02) : 262 - 276
  • [32] AN ANT COLONY OPTIMIZATION BASED INTER DOMAIN CLUSTER MAPPING FOR DOMAIN ADAPTATION IN REMOTE SENSING
    Sharma, Shakti
    Buddhiraju, Krishna Mohan
    Banerjee, Biplab
    2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 2158 - 2161
  • [33] Constrained multitasking optimization via co-evolution and domain adaptation
    Zhang, Tingyu
    Li, Dongcheng
    Li, Yanchi
    Gong, Wenyin
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 87
  • [34] Cross-Domain Extreme Learning Machines for Domain Adaptation
    Li, Shuang
    Song, Shiji
    Huang, Gao
    Wu, Cheng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (06): : 1194 - 1207
  • [35] A Review on Evolutionary Multitask Optimization: Trends and Challenges
    Wei, Tingyang
    Wang, Shibin
    Zhong, Jinghui
    Liu, Dong
    Zhang, Jun
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2022, 26 (05) : 941 - 960
  • [36] Evolutionary Multitask Optimization With Adaptive Knowledge Transfer
    Xu, Hao
    Qin, A. K.
    Xia, Siyu
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2022, 26 (02) : 290 - 303
  • [37] Self-Regulated Evolutionary Multitask Optimization
    Zheng, Xiaolong
    Qin, A. K.
    Gong, Maoguo
    Zhou, Deyun
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (01) : 16 - 28
  • [38] Positive-Unlabeled Domain Adaptation
    Sonntag, Jonas
    Behrens, Gunnar
    Schmidt-Thieme, Lars
    2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 66 - 75
  • [39] Domain Adaptation Approach for Sentiment Analysis
    Yu, Hong
    Pan, Yueqi
    Zhou, Chang
    PROCEEDINGS OF THE 2019 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTE AND DATA ANALYSIS (ICCDA 2019), 2019, : 94 - 97
  • [40] Heterogeneous Domain Adaptation: An Unsupervised Approach
    Liu, Feng
    Zhang, Guangquan
    Lu, Jie
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (12) : 5588 - 5602