A Performance Enhancement of Deepfake Video Detection through the use of a Hybrid CNN Deep Learning Model

被引:0
|
作者
Ikram, Sumaiya Thaseen [1 ]
Priya, V [1 ]
Chambial, Shourya [1 ]
Sood, Dhruv [1 ]
Arulkumar, V [2 ]
机构
[1] Engn Vellore Inst Technol, Sch Informat Technol, Vellore, Tamil Nadu, India
[2] Engn Vellore Inst Technol, Sch Comp Sci, Vellore, Tamil Nadu, India
关键词
Deepfake; Machine learning; Deep learning; Inception; Xception;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the current era, many fake videos and images are created with the help of various software and new AI (Artificial Intelligence) technologies, which leave a few hints of manipulation. There are many unethical ways videos can be used to threaten, fight, or create panic among people. It is important to ensure that such methods are not used to create fake videos. An AI-based technique for the synthesis of human images is called Deep Fake. They are created by combining and superimposing existing videos onto the source videos. In this paper, a system is developed that uses a hybrid Convolutional Neural Network (CNN) consisting of InceptionResnet v2 and Xception to extract frame-level features. Experimental analysis is performed using the DFDC deep fake detection challenge on Kaggle. These deep learning-based methods are optimized to increase accuracy and decrease training time by using this dataset for training and testing. We achieved a precision of 0.985, a recall of 0.96, an f1-score of 0.98, and support of 0.968.
引用
收藏
页码:169 / 178
页数:10
相关论文
共 50 条
  • [1] Hybrid Deep-Learning Model for Deepfake Detection in Video using Transfer Learning Approach
    Pandey, Raksha
    Kushwaha, Alok Kumar Singh
    NATIONAL ACADEMY SCIENCE LETTERS-INDIA, 2024,
  • [2] Deepfake Detection through Deep Learning
    Pan, Deng
    Sun, Lixian
    Wang, Rui
    Zhang, Xingjian
    Sinnott, Richard O.
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES (BDCAT 2020), 2020, : 134 - 143
  • [3] HCiT: Deepfake Video Detection Using a Hybrid Model of CNN features and Vision Transformer
    Kaddar, Bachir
    Fezza, Sid Ahmed
    Hamidouche, Wassim
    Akhtar, Zahid
    Hadid, Abdenour
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [4] Deepfake Video Detection through Optical Flow based CNN
    Amerini, Irene
    Galteri, Leonardo
    Caldelli, Roberto
    Del Bimbo, Alberto
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1205 - 1207
  • [5] AN EFFICIENT DEEP VIDEO MODEL FOR DEEPFAKE DETECTION
    Sun, Ruipeng
    Zhao, Ziyuan
    Shen, Li
    Zeng, Zeng
    Li, Yuxin
    Veeravalli, Bharadwaj
    Yang Xulei
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 351 - 355
  • [6] A Hybrid CNN-LSTM model for Video Deepfake Detection by Leveraging Optical Flow Features
    Saikia, Pallabi
    Dholaria, Dhwani
    Yadav, Priyanka
    Patel, Vaidehi
    Roy, Mohendra
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] On the Generalization of Deep Learning Models in Video Deepfake Detection
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    JOURNAL OF IMAGING, 2023, 9 (05)
  • [8] Deepfake video detection using deep learning algorithms
    Korkmaz, Sahin
    Alkan, Mustafa
    JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2023, 26 (02): : 855 - 862
  • [9] An efficient deepfake video detection using robust deep learning
    Qadir, Abdul
    Mahum, Rabbia
    El-Meligy, Mohammed A.
    Ragab, Adham E.
    AlSalman, Abdulmalik
    Awais, Muhammad
    HELIYON, 2024, 10 (05)
  • [10] An Investigation into the Utilisation of CNN with LSTM for Video Deepfake Detection
    Tipper, Sarah
    Atlam, Hany F.
    Lallie, Harjinder Singh
    APPLIED SCIENCES-BASEL, 2024, 14 (21):