Auguring Fake Face Images Using Dual Input Convolution Neural Network

被引:8
作者
Bhandari, Mohan [1 ]
Neupane, Arjun [2 ]
Mallik, Saurav [3 ,4 ]
Gaur, Loveleen [5 ,6 ,7 ]
Qin, Hong [8 ]
机构
[1] Samriddhi Coll, Dept Sci & Technol, Bhaktapur 44800, Nepal
[2] Cent Queensland Univ, Sch Engn & Technol, Norman Gardens, Rockhampton, Qld 4701, Australia
[3] Harvard Univ, Sch Publ Hlth, Dept Environm Hlth, Boston, MA 02115 USA
[4] Univ Arizona, Tucson, AZ 85721 USA
[5] Amity Univ, Amity Int Business Sch, Noida 201303, India
[6] Taylor Univ, Sch Comp Sci, Subang Jaya 47500, Malaysia
[7] Univ South Pacific, Grad Sch Business, Suva 1168, Fiji
[8] Univ Tennessee, Dept Comp Sci & Engn, Chattanooga, TN 37996 USA
关键词
Convolutional Neural Network (CNN); deepfakes; face detection; SHAP; XAI;
D O I
10.3390/jimaging9010003
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lacking, making it difficult to identify fake photos in situations with further compression, blurring, scaling, etc. Deep learning models resolve the research gap to correctly recognize phony images, whose objectionable content might encourage fraudulent activity and cause major problems. To reduce the gap and enlarge the fields of view of the network, we propose a dual input convolutional neural network (DICNN) model with ten-fold cross validation with an average training accuracy of 99.36 +/- 0.62, a test accuracy of 99.08 +/- 0.64, and a validation accuracy of 99.30 +/- 0.94. Additionally, we used 'SHapley Additive exPlanations (SHAP) ' as explainable AI (XAI) Shapely values to explain the results and interoperability visually by imposing the model into SHAP. The proposed model holds significant importance for being accepted by forensics and security experts because of its distinctive features and considerably higher accuracy than state-of-the-art methods.
引用
收藏
页数:11
相关论文
共 54 条
[31]   Deep Learning Based One-Class Detection System for Fake Faces Generated by GAN Network [J].
Li, Shengyin ;
Dutta, Vibekananda ;
He, Xin ;
Matsumaru, Takafumi .
SENSORS, 2022, 22 (20)
[32]   Explanation-Driven HCI Model to Examine the Mini-Mental State for Alzheimer's Disease [J].
Loveleen, Gaur ;
Mohan, Bhandari ;
Shikhar, Bhadwal Singh ;
Nz, Jhanjhi ;
Shorfuzzaman, Mohammad ;
Masud, Mehedi .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (02)
[33]  
Lundberg SM, 2017, ADV NEUR IN, V30
[34]   THYROID CANCER COMPUTER-AIDED DIAGNOSIS SYSTEM USING MRI-BASED MULTI-INPUT CNN MODEL [J].
Naglah, Ahmed ;
Khalifa, Fahmi ;
Khaled, Reem ;
Razek, Ahmed Abdel Khalek Abdel ;
El-Baz, Ayman .
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, :1691-1694
[35]  
Nightingale S., 2021, J VISUAL-JAPAN
[36]   Representations of machine vision technologies in artworks, games and narratives: A dataset [J].
Rettberg, Jill Walker ;
Kronman, Linda ;
Solberg, Ragnhild ;
Gunderson, Marianne ;
Bjorklund, Stein Magne ;
Stokkedal, Linn Heidi ;
Jacob, Kurdin ;
de Seta, Gabriele ;
Markham, Annette .
DATA IN BRIEF, 2022, 42
[37]   FaceForensics plus plus : Learning to Detect Manipulated Facial Images [J].
Roessler, Andreas ;
Cozzolino, Davide ;
Verdoliva, Luisa ;
Riess, Christian ;
Thies, Justus ;
Niessner, Matthias .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1-11
[38]  
Salman FM., 2022, IJAER, V6, P1
[39]   Natural language processing for Nepali text: a review [J].
Shahi, Tej Bahadur ;
Sitaula, Chiranjibi .
ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (04) :3401-3429
[40]   Monkeypox Virus Detection Using Pre-trained Deep Learning-based Approaches [J].
Sitaula, Chiranjibi ;
Shahi, Tej Bahadur .
JOURNAL OF MEDICAL SYSTEMS, 2022, 46 (11)