A Novel Blockchain-Based Deepfake Detection Method Using Federated and Deep Learning Models

被引:68
作者
Heidari, Arash [1 ]
Navimipour, Nima Jafari [2 ,3 ]
Dag, Hasan [4 ]
Talebi, Samira [5 ]
Unal, Mehmet [6 ]
机构
[1] Halic Univ, Dept Software Engn, Istanbul, Turkiye
[2] Kadir Has Univ, Dept Comp Engn, Istanbul, Turkiye
[3] Natl Yunlin Univ Sci & Technol, Future Technol Res Ctr, Yunlin 64002, Taiwan
[4] Kadir Has Univ, Dept Informat Technol, Istanbul, Turkiye
[5] Univ Texas San Antonio, Dept Comp Sci, San Antonio, TX USA
[6] Nisantasi Univ, Dept Comp Engn, Istanbul, Turkiye
关键词
Blockchain; Convolutional neural network; Deepfake; Transfer learning; QoS; Privacy; Federated learning; NEURAL-NETWORKS;
D O I
10.1007/s12559-024-10255-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the proliferation of deep learning (DL) techniques has given rise to a significant challenge in the form of deepfake videos, posing a grave threat to the authenticity of media content. With the rapid advancement of DL technology, the creation of convincingly realistic deepfake videos has become increasingly prevalent, raising serious concerns about the potential misuse of such content. Deepfakes have the potential to undermine trust in visual media, with implications for fields as diverse as journalism, entertainment, and security. This study presents an innovative solution by harnessing blockchain-based federated learning (FL) to address this issue, focusing on preserving data source anonymity. The approach combines the strengths of SegCaps and convolutional neural network (CNN) methods for improved image feature extraction, followed by capsule network (CN) training to enhance generalization. A novel data normalization technique is introduced to tackle data heterogeneity stemming from diverse global data sources. Moreover, transfer learning (TL) and preprocessing methods are deployed to elevate DL performance. These efforts culminate in collaborative global model training zfacilitated by blockchain and FL while maintaining the utmost confidentiality of data sources. The effectiveness of our methodology is rigorously tested and validated through extensive experiments. These experiments reveal a substantial improvement in accuracy, with an impressive average increase of 6.6% compared to six benchmark models. Furthermore, our approach demonstrates a 5.1% enhancement in the area under the curve (AUC) metric, underscoring its ability to outperform existing detection methods. These results substantiate the effectiveness of our proposed solution in countering the proliferation of deepfake content. In conclusion, our innovative approach represents a promising avenue for advancing deepfake detection. By leveraging existing data resources and the power of FL and blockchain technology, we address a critical need for media authenticity and security. As the threat of deepfake videos continues to grow, our comprehensive solution provides an effective means to protect the integrity and trustworthiness of visual media, with far-reaching implications for both industry and society. This work stands as a significant step toward countering the deepfake menace and preserving the authenticity of visual content in a rapidly evolving digital landscape.
引用
收藏
页码:1073 / 1091
页数:19
相关论文
共 72 条
[1]  
Abedi M., 2012, Proceedings of the international conference on scientific computing (CSC) (p. 1)
[2]   An Efficient Design of Multiplier for Using in Nano-Scale IoT Systems Using Atomic Silicon [J].
Ahmadpour, Seyed-Sajad ;
Heidari, Arash ;
Navimpour, Nima Jafari ;
Asadi, Mohammad-Ali ;
Yalcin, Senay .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (16) :14908-14909
[3]   Optical Flow based CNN for detection of unlearnt deepfake manipulations [J].
Caldelli, Roberto ;
Galteri, Leonardo ;
Amerini, Irene ;
Del Bimbo, Alberto .
PATTERN RECOGNITION LETTERS, 2021, 146 :31-37
[4]   Enhancing Physical-Layer Security for IoT With Nonorthogonal Multiple Access Assisted Semi-Grant-Free Transmission [J].
Cao, Kunrui ;
Ding, Haiyang ;
Wang, Buhong ;
Lv, Lu ;
Tian, Jiwei ;
Wei, Qingmei ;
Gong, Fengkui .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) :24669-24681
[5]   Improving Physical Layer Security of Uplink NOMA via Energy Harvesting Jammers [J].
Cao, Kunrui ;
Wang, Buhong ;
Ding, Haiyang ;
Lv, Lu ;
Dong, Runze ;
Cheng, Tianhao ;
Gong, Fengkui .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 :786-799
[6]  
Chen B, 2021, SECUR COMMUN NETW, V2021
[7]   Disparity-Based Multiscale Fusion Network for Transportation Detection [J].
Chen, Jing ;
Wang, Qichao ;
Peng, Weiming ;
Xu, Haitao ;
Li, Xiaodong ;
Xu, Wenqiang .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :18855-18863
[8]   Recurrent Convolutional Structures for Audio Spoof and Video Deepfake Detection [J].
Chintha, Akash ;
Thai, Bao ;
Sohrawardi, Saniat Javid ;
Bhatt, Kartavya ;
Hickerson, Andrea ;
Wright, Matthew ;
Ptucha, Raymond .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (05) :1024-1037
[9]  
Darbandi M., 2018, 2018 INT C COMMUNICA
[10]  
Darbandi M., 2017, Int J Technol Innov Res, V23, P10, DOI DOI 10.5281/ZENODO.345288