FedBPM:A decentralized federated meta-method for heterogeneous and complex image classification via multi-scale feature fusion

被引:0
作者
Liu, Wei [2 ,3 ,4 ]
Li, Kaige [1 ]
Zheng, Yurong [2 ]
She, Wei [2 ,4 ]
Tian, Zhao [2 ,4 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artif Intelligent, Zhengzhou 450000, Peoples R China
[2] Zhengzhou Univ, Sch Cyber Sci & Engn, Zhengzhou 450000, Peoples R China
[3] Henan Key Lab Network Cryptog Technol, Zhengzhou 450000, Peoples R China
[4] Zhengzhou Key Lab Blockchain & Data Intelligence, Zhengzhou 450000, Peoples R China
关键词
Federated learning; Meta-learning; Multi-scale feature fusion; Blockchain; BLOCKCHAIN;
D O I
10.1007/s00607-024-01405-8
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Federated learning is a promising privacy-preserving paradigm for collaboratively training global machine learning models across distributed devices. However, traditional federated learning encounters difficulties in training global model and issues of single-point failure when faced with complex and diverse distributed data. In this paper, we propose a decentralized federated learning approach based on meta-learning and equalized multi-scale feature fusion to enhance the accuracy of the classification task. Firstly, we present a platform architecture of blockchain-based federated learning systems for data sharing among clients, which achieves a trusted decentralized framework. In this architecture, we construct personalized federated learning models tailored to individual users by utilizing meta-learning techniques. Secondly, to address the challenge of fusing complex data features from local users, we formulate a novel equalized multi-scale feature fusion method that employs the dual attention mechanism to extract local data features in a fine-grained manner. Experimental results demonstrate that the proposed approach improves the accuracy by approximately 2% and reduces the loss by approximately 0.25 compared to mainstream federated learning methods.
引用
收藏
页数:26
相关论文
共 38 条
[1]  
Acar DAE, 2021, Arxiv, DOI arXiv:2111.04263
[2]  
Augenstein S, 2021, Arxiv, DOI arXiv:2111.12150
[3]  
Caldas S., 2018, arXiv
[4]   A Decentralized Federated Learning Framework via Committee Mechanism With Convergence Guarantee [J].
Che, Chunjiang ;
Li, Xiaoli ;
Chen, Chuan ;
He, Xiaoyu ;
Zheng, Zibin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) :4783-4800
[5]  
Chen F, 2019, Arxiv, DOI arXiv:1802.07876
[6]   FedMAX: Mitigating Activation Divergence for Accurate and Communication-Efficient Federated Learning [J].
Chen, Wei ;
Bhardwaj, Kartikeya ;
Marculescu, Radu .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT II, 2021, 12458 :348-363
[7]  
Deng L., 2012, IEEE SIGNAL PROC MAG, V29, P141, DOI [DOI 10.1109/MSP.2012.2211477, 10.1109/MSP.2012.2211477, 10.1109/msp.2012.2211477]
[8]  
Dinh CT, 2020, ADV NEUR IN, V33
[9]  
Fallah A, 2020, ADV NEUR IN, V33
[10]  
Finn C, 2017, PR MACH LEARN RES, V70