Deepfake detection of occluded images using a patch-based approach

被引:1
作者
Soleimani, Mahsa [1 ]
Nazari, Ali [1 ]
Moghaddam, Mohsen Ebrahimi [1 ]
机构
[1] Shahid Beheshti Univ, Fac Comp Sci & Engn, Tehran 1983969411, Iran
关键词
DeepFake; Deep learning; Generative adversarial networks;
D O I
10.1007/s00530-023-01140-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
DeepFake involves the use of deep learning and artificial intelligence techniques to produce or change video and image contents typically generated by GANs. Moreover, it can be misused and leads to fictitious news, ethical and financial crimes, and also affects the performance of facial recognition systems. Thus, detection of real or fake images is significant specially to authenticate originality of people's images or videos. One of the most important challenges in this topic is obstruction that decreases the system precision. In this study, we present a deep learning approach using the entire face and face patches to distinguish real/fake images in the presence of limitations of blurring, compression, scaling and especially obstruction with a three-path decision: first entire-face reasoning, second a decision based on the concatenation of feature vectors of face patches, and third a majority vote decision based on these features. To test our approach, new data sets including real and fake images are created. For producing fake images, StyleGAN and StyleGAN2 are trained by FFHQ images and also StarGAN and PGGAN are trained by CelebA images. The CelebA and FFHQ data sets are used as real images. The proposed approach reaches higher results in early epochs than other methods and increases the SoTA results by 0.4%-7.9% in the different built data sets. In addition, we have shown in experimental results that weighing the patches may improve accuracy.
引用
收藏
页码:2669 / 2687
页数:19
相关论文
共 50 条
[41]   Data augmentation for patch-based OCT chorio-retinal segmentation using generative adversarial networks [J].
Kugelman, Jason ;
Alonso-Caneiro, David ;
Read, Scott A. ;
Vincent, Stephen J. ;
Chen, Fred K. ;
Collins, Michael J. .
NEURAL COMPUTING & APPLICATIONS, 2021, 33 (13) :7393-7408
[42]   Data augmentation for patch-based OCT chorio-retinal segmentation using generative adversarial networks [J].
Jason Kugelman ;
David Alonso-Caneiro ;
Scott A. Read ;
Stephen J. Vincent ;
Fred K. Chen ;
Michael J. Collins .
Neural Computing and Applications, 2021, 33 :7393-7408
[43]   Patch-based probabilistic identification of plant roots using convolutional neural networks [J].
Cardellicchio, A. ;
Solimani, F. ;
Dimauro, G. ;
Summerer, S. ;
Reno, V. .
PATTERN RECOGNITION LETTERS, 2024, 183 :125-132
[44]   Using DCGANs and HOG plus Patch-Based CNN for Face Spoofing Mitigation [J].
Jenkins, John ;
Roy, Kaushik .
ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, PT IV, AIAI 2024, 2024, 714 :41-53
[45]   DEEPFAKE SPEECH DETECTION THROUGH EMOTION RECOGNITION: A SEMANTIC APPROACH [J].
Conti, Emanuele ;
Salvi, Davide ;
Borrelli, Clara ;
Hosler, Brian ;
Bestagini, Paolo ;
Antonacci, Fabio ;
Sarti, Augusto ;
Stamm, Matthew C. ;
Tubaro, Stefano .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :8962-8966
[46]   SAMPLING SUBJECTIVE POLYGONS FOR PATCH-BASED DEEP LEARNING LAND-USE CLASSIFICATION IN SATELLITE IMAGES [J].
Arndt, Jacob ;
Lunga, Dalton .
IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, :1953-1956
[47]   Deepfake Detection Using CNN Trained on Eye Region [J].
Johnson, David ;
Gwyn, Tony ;
Qingge, Letu ;
Roy, Kaushik .
ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE: THEORY AND PRACTICES IN ARTIFICIAL INTELLIGENCE, 2022, 13343 :443-451
[48]   Autoencoder-based Data Augmentation for Deepfake Detection [J].
Stanciu, Dan-Cristian ;
Ionescu, Bogdan .
PROCEEDINGS OF THE 2ND ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISCRIMINATION, MAD 2023, 2023, :19-27
[49]   Multi-Level Seg-Unet Model with Global and Patch-Based X-ray Images for Knee Bone Tumor Detection [J].
Do, Nhu-Tai ;
Jung, Sung-Taek ;
Yang, Hyung-Jeong ;
Kim, Soo-Hyung .
DIAGNOSTICS, 2021, 11 (04)
[50]   A patch-based deep learning framework with 5-B network for breast cancer multi-classification using histopathological images [J].
Jackson, Jehoiada ;
Jackson, Linda E. ;
Ukwuoma, Chiagoziem C. ;
Kissi, Maame D. ;
Oluwasanmi, Ariyo ;
Qin, Zhiguang .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 148