Adaptive dual graph regularization for clustered multi-task learning

被引:3
|
作者
Liu, Cheng [1 ]
Li, Rui [1 ]
Chen, Sentao [1 ]
Zheng, Lin [1 ]
Jiang, Dazhi [1 ]
机构
[1] Shantou Univ, Dept Comp Sci, Shantou, Peoples R China
关键词
Multi-task learning; Adaptive graph-guided regularization; SELECTION; SHRINKAGE;
D O I
10.1016/j.neucom.2024.127259
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The key challenge of multi -task learning is how to exploit the structure across all tasks. In practice, relevant tasks are partially associated with similar meaningful feature subgroups, which implies an overlapped taskfeature co-cluster structure. Besides discovering relationships at the task level, collaboratively identifying relevant meaningful structure relationship among features is beneficial to properly capture the structure of tasks. Toward this aim, we propose a clustered multi -task learning approach that collaboratively learns the cluster structure for both task and feature level effects. Specifically, an adaptive dual graph regularization, which respectively formulates the similarity of tasks and features, is introduced to guide the learning process to discover task -feature co-cluster relationship in a flexible way. Additionally, without any prior knowledge, the similarity weight of dual graph regularization can be automatically inferred through adaptive graph learning during model training. Experimental studies validate the effectiveness of our approach in terms of improving predictive performance and capturing clear cluster structure among tasks. The source code of the proposed method is available at GitHub: https://github.com/CLiu272/AdualGraph.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Dual adaptive learning multi-task multi-view for graph network representation learning
    Han, Beibei
    Wei, Yingmei
    Wang, Qingyong
    Wan, Shanshan
    NEURAL NETWORKS, 2023, 162 : 297 - 308
  • [2] Federated Multi-task Graph Learning
    Liu, Yijing
    Han, Dongming
    Zhang, Jianwei
    Zhu, Haiyang
    Xu, Mingliang
    Chen, Wei
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [3] Learning rates for multi-task regularization networks
    Gui, Jie
    Zhang, Haizhang
    NEUROCOMPUTING, 2021, 466 : 243 - 251
  • [4] Flexible Clustered Multi-Task Learning by Learning Representative Tasks
    Zhou, Qiang
    Zhao, Qi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 266 - 278
  • [5] ADAPTIVE AND ROBUST MULTI-TASK LEARNING
    Duan, Yaqi
    Wang, Kaizheng
    ANNALS OF STATISTICS, 2023, 51 (05): : 2015 - 2039
  • [6] Robust Task Grouping with Representative Tasks for Clustered Multi-Task Learning
    Yao, Yaqiang
    Cao, Jie
    Chen, Huanhuan
    KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1408 - 1417
  • [7] Adaptive Activation Network and Functional Regularization for Efficient and Flexible Deep Multi-Task Learning
    Liu, Yingru
    Yang, Xuewen
    Xie, Dongliang
    Wang, Xin
    Shen, Li
    Huang, Haozhi
    Balasubramanian, Niranjan
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 4924 - 4931
  • [8] Distributed Adaptive Multi-Task Learning Based on Partially Observed Graph Signals
    Xia, Wei
    Chen, Junbin
    Yu, Lisha
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2021, 7 : 522 - 538
  • [9] DGE-GSIM: A multi-task dual graph embedding learning for graph similarity computation
    Tan, Wenhui
    Cao, Peng
    Jin, Zhiyong
    Luo, Futao
    Wen, Guangqi
    Li, Weiping
    PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 39 - 47
  • [10] Graph-based Multi-task Learning
    Li, Ya
    Tian, Xinmei
    2015 IEEE 16TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2015, : 730 - 733