Federated Learning FedLTailor: A Dynamic Weight Adjustment and Personalized Fusion Approach

被引:0
作者
Zheng, Hong [1 ]
Li, Shanqin [1 ]
机构
[1] Changchun Univ Technol, Sch Comp Sci & Engn, Changchun 130022, Jilin, Peoples R China
关键词
Federated learning; knowledge graph completion; knowledge graph;
D O I
10.1109/ACCESS.2024.3407669
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we primarily address the issue of uneven quality of client embeddings in existing federated learning frameworks for knowledge graph completion. Although existing frameworks provide preliminary solutions to the heterogeneity of data in knowledge graphs, there are still deficiencies in their aggregation strategies. To address this issue, we introduce a new federated learning framework called FedLTailor that focuses on optimizing the aggregation process. FedLTailor employs a dynamic weight adjustment strategy to enhance the weight proportion of clients with higher embedding quality during the aggregation process, thereby optimizing the performance of the global model. Moreover, FedLTailor adopted a unique personalized fusion strategy to mitigate potential discrepancies between the global model and local clients. Experimental results on four federated knowledge graph datasets demonstrate FedLTailor's significant advantages in addressing aggregation issues in federated knowledge graph completion tasks, as well as its broad adaptability across various knowledge graph embedding techniques. Additionally, the design and experimental validation of the FedLTailor framework offers new insights into the field of federated learning, particularly in handling distributed knowledge graph data, showcasing its potential applicability and effectiveness.
引用
收藏
页码:78101 / 78109
页数:9
相关论文
共 18 条
[1]  
Bordes N., 2013, Adv. Neural Inf. Process. Syst., V26
[2]  
Chen CC, 2020, Arxiv, DOI arXiv:2011.10180
[3]   Federated knowledge graph completion via embedding-contrastive learning [J].
Chen, Mingyang ;
Zhang, Wen ;
Yuan, Zonggang ;
Jia, Yantao ;
Chen, Huajun .
KNOWLEDGE-BASED SYSTEMS, 2022, 252
[4]   FedE: Embedding Knowledge Graphs in Federated Setting [J].
Chen, Mingyang ;
Zhang, Wen ;
Yuan, Zonggang ;
Jia, Yantao ;
Chen, Huajun .
PROCEEDINGS OF THE 10TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE GRAPHS (IJCKG 2021), 2021, :80-88
[5]   An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge [J].
Hao, Yanchao ;
Zhang, Yuanzhe ;
Liu, Kang ;
He, Shizhu ;
Liu, Zhanyi ;
Wu, Hua ;
Zhao, Jun .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :221-231
[6]  
Kingma Diederik P, 2014, ARXIV PREPRINT ARXIV
[7]   Model-Contrastive Federated Learning [J].
Li, Qinbin ;
He, Bingsheng ;
Song, Dawn .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10708-10717
[8]  
Li T., 2020, PROC MACH LEARN SYST, V2, P429, DOI DOI 10.48550/ARXIV.1812.06127
[9]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
[10]  
Sun ZQ, 2019, Arxiv, DOI arXiv:1902.10197