Adaptive dual graph regularization for clustered multi-task learning

被引:3
作者
Liu, Cheng [1 ]
Li, Rui [1 ]
Chen, Sentao [1 ]
Zheng, Lin [1 ]
Jiang, Dazhi [1 ]
机构
[1] Shantou Univ, Dept Comp Sci, Shantou, Peoples R China
关键词
Multi-task learning; Adaptive graph-guided regularization; SELECTION; SHRINKAGE;
D O I
10.1016/j.neucom.2024.127259
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The key challenge of multi -task learning is how to exploit the structure across all tasks. In practice, relevant tasks are partially associated with similar meaningful feature subgroups, which implies an overlapped taskfeature co-cluster structure. Besides discovering relationships at the task level, collaboratively identifying relevant meaningful structure relationship among features is beneficial to properly capture the structure of tasks. Toward this aim, we propose a clustered multi -task learning approach that collaboratively learns the cluster structure for both task and feature level effects. Specifically, an adaptive dual graph regularization, which respectively formulates the similarity of tasks and features, is introduced to guide the learning process to discover task -feature co-cluster relationship in a flexible way. Additionally, without any prior knowledge, the similarity weight of dual graph regularization can be automatically inferred through adaptive graph learning during model training. Experimental studies validate the effectiveness of our approach in terms of improving predictive performance and capturing clear cluster structure among tasks. The source code of the proposed method is available at GitHub: https://github.com/CLiu272/AdualGraph.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Asymmetric Multi-Task Learning with Local Transference
    Oliveira, Saullo H. G.
    Goncalves, Andre R.
    Von Zuben, Fernando J.
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2022, 16 (05)
  • [22] Heterogeneous multi-task feature learning with mixed l2,1 regularization
    Zhong, Yuan
    Xu, Wei
    Gao, Xin
    [J]. MACHINE LEARNING, 2024, 113 (02) : 891 - 932
  • [23] Multi-task gradient descent for multi-task learning
    Lu Bai
    Yew-Soon Ong
    Tiantian He
    Abhishek Gupta
    [J]. Memetic Computing, 2020, 12 : 355 - 369
  • [24] Multi-task gradient descent for multi-task learning
    Bai, Lu
    Ong, Yew-Soon
    He, Tiantian
    Gupta, Abhishek
    [J]. MEMETIC COMPUTING, 2020, 12 (04) : 355 - 369
  • [25] Robust Estimator based Adaptive Multi-Task Learning
    Zhu, Peiyuan
    Chen, Cailian
    He, Jianping
    Zhu, Shanying
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 740 - 747
  • [26] Adaptive multi-task learning for speech to text translation
    Feng, Xin
    Zhao, Yue
    Zong, Wei
    Xu, Xiaona
    [J]. EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2024, 2024 (01):
  • [27] A Multi-Task Learning Approach for Recommendation based on Knowledge Graph
    Yan, Cairong
    Liu, Shuai
    Zhang, Yanting
    Wang, Zijian
    Wang, Pengwei
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [28] Multi-task heterogeneous graph learning on electronic health records
    Chan, Tsai Hor
    Yin, Guosheng
    Bae, Kyongtae
    Yu, Lequan
    [J]. NEURAL NETWORKS, 2024, 180
  • [29] A Multi-Task Representation Learning Architecture for Enhanced Graph Classification
    Xie, Yu
    Gong, Maoguo
    Gao, Yuan
    Qin, A. K.
    Fan, Xiaolong
    [J]. FRONTIERS IN NEUROSCIENCE, 2020, 13
  • [30] Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation
    Wang, Hongwei
    Zhang, Fuzheng
    Zhao, Miao
    Li, Wenjie
    Xie, Xing
    Guo, Minyi
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 2000 - 2010