DFT-MF: Enhanced deepfake detection using mouth movement and transfer learning

被引:18
作者
Elhassan, Ammar [1 ]
Al-Fawa'reh, Mohammad [2 ]
Jafar, Mousa Tayseer [1 ]
Ababneh, Mohammad [1 ]
Jafar, Shifaa Tayseer [1 ]
机构
[1] Princess Sumaya Univ Technol, Amman, Jordan
[2] Yarmouk Univ, Irbid, Jordan
关键词
Fake videos; Detection; Deep learning; Transfer learning; Deepfake; Manipulation;
D O I
10.1016/j.softx.2022.101115
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deepfake technology presents serious cybersecurity challenges that have become more prevalent with the availability of easily accessible applications. An effective method for detection and prevention of this is necessary. This paper introduces a robust approach and software implementation to detect fake videos constructed with Deep Learning technology that depends on utilizing teeth and mouth movement as distinguishing features that remain very difficult to perfect when faking videos. The proposed methodology has a higher efficiency and accuracy of fake video detection than similar approaches. The work in this article is an extension of previous work that introduced the main concepts with additional application of multi-transfer learning approaches including DenseNet121, DenseNet169, EfficientNetB0, EfficientNetB7, InceptionV3, MobileNet, ResNet50, vgg16, vgg19 and Xception to enhance the algorithm???s ability to detect and classify Deepfake videos based on features extracted from the teeth and mouth frames as a biological signal. ?? 2022 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
引用
收藏
页数:10
相关论文
共 18 条
[1]  
[Anonymous], 2022, LUXAND DETECT CROP H
[2]  
[Anonymous], 2018, ASSESSMENT DETECTION
[3]   FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition [J].
Ding, Hui ;
Zhou, Shaohua Kevin ;
Chellappa, Rama .
2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, :118-126
[4]  
Güera D, 2018, 2018 15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), P127
[5]   Digital Forensics and Analysis of Deepfake Videos [J].
Jafar, Mousa Tayseer ;
Ababneh, Mohammad ;
Al-Zoube, Mohammad ;
Ethassan, Ammar .
2020 11TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2020, :053-058
[6]   Eye and mouth state detection algorithm based on contour feature extraction [J].
Ji, Yingyu ;
Wang, Shigang ;
Lu, Yang ;
Wei, Jian ;
Zhao, Yan .
JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (05)
[7]  
Jiang HZ, 2017, IEEE INT CONF AUTOMA, P650, DOI [10.1109/FG.2017.82, 10.1109/MWSYM.2017.8058653]
[8]   Deepfakes: perspectives on the future "reality" of advertising and branding [J].
Kietzmann, Jan ;
Mills, Adam J. ;
Plangger, Kirk .
INTERNATIONAL JOURNAL OF ADVERTISING, 2021, 40 (03) :473-485
[9]  
King DE, 2009, J MACH LEARN RES, V10, P1755
[10]  
Korshunov P., 2019, ARXIV PREPR ARXIV191