Deep learning model to detect deceptive generative adversarial network generated images using multimedia forensic

被引:4
|
作者
Byeon, Haewon [1 ]
Shabaz, Mohammad [2 ]
Shrivastava, Kapil [3 ]
Joshi, Anjali [4 ]
Keshta, Ismail [5 ]
Oak, Rajvardhan [6 ]
Singh, Pavitar Parkash [7 ]
Soni, Mukesh [8 ]
机构
[1] Inje Univ, Dept Digital Antiaging Healthcare, Gimhae 50834, South Korea
[2] Model Inst Engn & Technol, Jammu, J&K, India
[3] GLA Univ, Dept Comp Engn & Applicat, Mathura 2821406, India
[4] Marathwada Mitra Mandals Inst Technol, Dept Mech Engn, Lohagaon Pune, India
[5] AlMaarefa Univ, Coll Appl Sci, Comp Sci & Informat Syst Dept, Riyadh, Saudi Arabia
[6] Univ Calif Davis, Dept Comp Sci, Davis, CA USA
[7] Lovely Profess Univ, Dept Management, Phagwara, India
[8] Chandigarh Univ, Dept CSE, Univ Ctr Res & Dev, Mohali 140413, Punjab, India
关键词
Deep learning; GANs; Deepfake; Image tampering; Information hiding; Multimedia forensic; Image detection; GAN;
D O I
10.1016/j.compeleceng.2023.109024
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Computer-generated imagery has been made more lifelike and misleading by new Generative Adversarial Network (GAN) models, such as StyleGAN, posing severe risks to people's safety, social order, and privacy. Deceptive content creation, including Deepfakes, image tampering, and information hiding, can be facilitated through the misuse of GANs. To tackle these challenges, a detection model is proposed in this research, employing a spatial-frequency joint dual-stream convolutional neural network. Learnable frequency-domain filtering kernels and frequencydomain networks are leveraged to thoroughly learn and extract frequency-domain features, considering the discernible artifacts left by GAN images in the frequency spectrum due to the upsampling process during production. Lastly, the two sets of traits are combined to identify GAN-created faces. The proposed model outperforms state-of-the-art methods, as evidenced by experimental findings on various datasets, both in terms of detection accuracy on high-quality created datasets and generalization across datasets.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Embedding Image Through Generated Intermediate Medium Using Deep Convolutional Generative Adversarial Network
    Li, Chuanlong
    Jiang, Yumeng
    Cheslyar, Marta
    CMC-COMPUTERS MATERIALS & CONTINUA, 2018, 56 (02): : 313 - 324
  • [2] Embedding image through generated intermediate medium using deep convolutional generative adversarial network
    Li C.
    Jiang Y.
    Cheslyar M.
    Li, Chuanlong (nuist_darko@outlook.com), 2018, Tech Science Press (56) : 313 - 324
  • [3] Evaluating Deep Learning Resilience in Retinal Fundus Classification with Generative Adversarial Networks Generated Images
    Di Giammarco, Marcello
    Santone, Antonella
    Cesarelli, Mario
    Martinelli, Fabio
    Mercaldo, Francesco
    ELECTRONICS, 2024, 13 (13)
  • [4] DLGAN: Undersampled MRI reconstruction using Deep Learning based Generative Adversarial Network
    Noor, Rida
    Wahid, Abdul
    Bazai, Sibghat Ullah
    Khan, Asad
    Fang, Meie
    Syam, M. S.
    Bhatti, Uzair Aslam
    Ghadi, Yazeed Yasin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [5] Improving CBCT quality to CT level using deep learning with generative adversarial network
    Zhang, Yang
    Yue, Ning
    Su, Min-Ying
    Liu, Bo
    Ding, Yi
    Zhou, Yongkang
    Wang, Hao
    Department, Yu Kuang
    Nie, Ke
    MEDICAL PHYSICS, 2021, 48 (06) : 2816 - 2826
  • [6] Enforcing Traffic Safety: A Deep Learning Approach for Detecting Motorcyclists' Helmet Violations Using YOLOv8 and Deep Convolutional Generative Adversarial Network-Generated Images
    Shoman, Maged
    Ghoul, Tarek
    Lanzaro, Gabriel
    Alsharif, Tala
    Gargoum, Suliman
    Sayed, Tarek
    ALGORITHMS, 2024, 17 (05)
  • [7] Generative Adversarial Network in the Air: Deep Adversarial Learning for Wireless Signal Spoofing
    Shi, Yi
    Davaslioglu, Kemal
    Sagduyu, Yalin E.
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) : 294 - 303
  • [8] A Deep Learning Model for Multi-Domain MRI Synthesis Using Generative Adversarial Networks
    Han, Le Hoang Ngoc
    Hien, Ngo Le Huy
    Huy, Luu Van
    Hieu, Nguyen Van
    INFORMATICA, 2024, 35 (02) : 283 - 309
  • [9] Evaluation of Generative Adversarial Network Performance Based on Direct Analysis of Generated Images
    Guan, Shuyue
    Loew, Murray
    2019 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2019,
  • [10] Deep learning-based auto segmentation using generative adversarial network on magnetic resonance images obtained for head and neck cancer patients
    Kawahara, Daisuke
    Tsuneda, Masato
    Ozawa, Shuichi
    Okamoto, Hiroyuki
    Nakamura, Mitsuhiro
    Nishio, Teiji
    Nagata, Yasushi
    JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2022, 23 (05):