Efficient Asynchronous Multi-Participant Vertical Federated Learning

被引:4
作者
Shi, Haoran [1 ]
Xu, Yonghui [2 ,3 ]
Jiang, Yali [1 ]
Yu, Han [4 ]
Cui, Lizhen [1 ,2 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250100, Peoples R China
[2] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res C FA, Jinan 250100, Peoples R China
[3] China Singapore Int Joint Res Inst, Guangzhou 510000, Peoples R China
[4] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Computational modeling; Stochastic processes; Training; Data models; Collaborative work; Privacy; Servers; Federated learning; privacy-preserving; asynchronous distributed computation;
D O I
10.1109/TBDATA.2022.3201729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vertical Federated Learning (VFL) is a private-preserving distributed machine learning paradigm that collaboratively trains machine learning models with participants whose local data overlap largely in the sample space, but not so in the feature space. Existing VFL methods are mainly based on synchronous computation and homomorphic encryption (HE). Due to the differences in the communication and computation resources of the participants, straggling participants can cause delays during synchronous VFL model training, resulting in low computational efficiency. In addition, HE incurs high computation and communication costs. Moreover, it is difficult to establish a VFL coordinator (a.k.a. server) that all participants can trust. To address these problems, we propose an efficient Asynchronous Multi-participant Vertical Federated Learning method (AMVFL). AMVFL leverages asynchronous training which reduces waiting time. At the same time, secret sharing is used instead of HE for privacy protection, which further reduces the computational cost. In addition, AMVFL does not require a trusted entity to serve as the VFL coordinator. Experimental results based on real-world and synthetic datasets demonstrate that AMVFL can significantly reduce computational cost and improve the accuracy of the model compared to five state-of-the-art VFL methods.
引用
收藏
页码:940 / 952
页数:13
相关论文
共 50 条
  • [21] Asynchronous Multi-Model Dynamic Federated Learning Over Wireless Networks: Theory, Modeling, and Optimization
    Chang, Zhan-Lun
    Hosseinalipour, Seyyedali
    Chiang, Mung
    Brinton, Christopher G.
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (05) : 1989 - 2004
  • [22] Adaptive Vertical Federated Learning on Unbalanced Features
    Zhang, Jie
    Guo, Song
    Qu, Zhihao
    Zeng, Deze
    Wang, Haozhao
    Liu, Qifeng
    Zomaya, Albert Y.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 4006 - 4018
  • [23] Secure and Efficient Federated Learning Against Model Poisoning Attacks in Horizontal and Vertical Data Partitioning
    Yu, Chong
    Meng, Zhenyu
    Zhang, Wenmiao
    Lei, Lei
    Ni, Jianbing
    Zhang, Kuan
    Zhao, Hai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [24] Asynchronous Federated Learning With Local Differential Privacy for Privacy-Enhanced Recommender Systems
    Zhao, Xiaopeng
    Bai, Xiao
    Sun, Guohao
    Yan, Zhe
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (07): : 7915 - 7929
  • [25] Achieving Linear Speedup in Asynchronous Federated Learning With Heterogeneous Clients
    Wang, Xiaolu
    Li, Zijian
    Jin, Shi
    Zhang, Jun
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (01) : 435 - 448
  • [26] Adaptive Transmission Scheduling in Wireless Networks for Asynchronous Federated Learning
    Lee, Hyun-Suk
    Lee, Jang-Won
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3673 - 3687
  • [27] MODA: Model Ownership Deprivation Attack in Asynchronous Federated Learning
    Zhang, Xiaoyu
    Lin, Shen
    Chen, Chao
    Chen, Xiaofeng
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (04) : 4220 - 4235
  • [28] Privacy-Preserving Asynchronous Grouped Federated Learning for IoT
    Zhang, Tao
    Song, Anxiao
    Dong, Xuewen
    Shen, Yulong
    Ma, Jianfeng
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (07): : 5511 - 5523
  • [29] Participant Selection for Federated Learning With Heterogeneous Data in Intelligent Transport System
    Zhao, Jianxin
    Chang, Xinyu
    Feng, Yanhao
    Liu, Chi Harold
    Liu, Ningbo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (01) : 1106 - 1115
  • [30] Efficient and Secure Federated Learning With Verifiable Weighted Average Aggregation
    Yang, Zhen
    Zhou, Ming
    Yu, Haiyang
    Sinnott, Richard O.
    Liu, Huan
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (01): : 205 - 222