Deep learning model to detect deceptive generative adversarial network generated images using multimedia forensic

被引:8
作者
Byeon, Haewon [1 ]
Shabaz, Mohammad [2 ]
Shrivastava, Kapil [3 ]
Joshi, Anjali [4 ]
Keshta, Ismail [5 ]
Oak, Rajvardhan [6 ]
Singh, Pavitar Parkash [7 ]
Soni, Mukesh [8 ]
机构
[1] Inje Univ, Dept Digital Antiaging Healthcare, Gimhae 50834, South Korea
[2] Model Inst Engn & Technol, Jammu, J&K, India
[3] GLA Univ, Dept Comp Engn & Applicat, Mathura 2821406, India
[4] Marathwada Mitra Mandals Inst Technol, Dept Mech Engn, Lohagaon Pune, India
[5] AlMaarefa Univ, Coll Appl Sci, Comp Sci & Informat Syst Dept, Riyadh, Saudi Arabia
[6] Univ Calif Davis, Dept Comp Sci, Davis, CA USA
[7] Lovely Profess Univ, Dept Management, Phagwara, India
[8] Chandigarh Univ, Dept CSE, Univ Ctr Res & Dev, Mohali 140413, Punjab, India
关键词
Deep learning; GANs; Deepfake; Image tampering; Information hiding; Multimedia forensic; Image detection; GAN;
D O I
10.1016/j.compeleceng.2023.109024
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Computer-generated imagery has been made more lifelike and misleading by new Generative Adversarial Network (GAN) models, such as StyleGAN, posing severe risks to people's safety, social order, and privacy. Deceptive content creation, including Deepfakes, image tampering, and information hiding, can be facilitated through the misuse of GANs. To tackle these challenges, a detection model is proposed in this research, employing a spatial-frequency joint dual-stream convolutional neural network. Learnable frequency-domain filtering kernels and frequencydomain networks are leveraged to thoroughly learn and extract frequency-domain features, considering the discernible artifacts left by GAN images in the frequency spectrum due to the upsampling process during production. Lastly, the two sets of traits are combined to identify GAN-created faces. The proposed model outperforms state-of-the-art methods, as evidenced by experimental findings on various datasets, both in terms of detection accuracy on high-quality created datasets and generalization across datasets.
引用
收藏
页数:16
相关论文
共 50 条
[21]   Farmland Segmentation in Landsat 8 Satellite Images Using Deep Learning and Conditional Generative Adversarial Networks [J].
Nair, Shruti ;
Sharifzadeh, Sara ;
Palade, Vasile .
REMOTE SENSING, 2024, 16 (05)
[22]   Restoration of haze-free images using Generative Adversarial Network [J].
Yi, Weichao ;
Liu, Ming ;
Dong, Liquan ;
Zhao, Yuejin ;
Liu, Xiaohua ;
Hui, Mei .
MIPPR 2019: REMOTE SENSING IMAGE PROCESSING, GEOGRAPHIC INFORMATION SYSTEMS, AND OTHER APPLICATIONS, 2020, 11432
[23]   Lung Cancer Segmentation With Transfer Learning: Usefulness of a Pretrained Model Constructed From an Artificial Dataset Generated Using a Generative Adversarial Network [J].
Nishio, Mizuho ;
Fujimoto, Koji ;
Matsuo, Hidetoshi ;
Muramatsu, Chisako ;
Sakamoto, Ryo ;
Fujita, Hiroshi .
FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2021, 4
[24]   Predicting Breast Cancer Events in Ductal Carcinoma In Situ (DCIS) Using Generative Adversarial Network Augmented Deep Learning Model [J].
Ghose, Soumya ;
Cho, Sanghee ;
Ginty, Fiona ;
McDonough, Elizabeth ;
Davis, Cynthia ;
Zhang, Zhanpan ;
Mitra, Jhimli ;
Harris, Adrian L. ;
Thike, Aye Aye ;
Tan, Puay Hoon ;
Gokmen-Polar, Yesim ;
Badve, Sunil S. .
CANCERS, 2023, 15 (07)
[25]   Adversarial Attacks and Defense on an Aircraft Classification Model Using a Generative Adversarial Network [J].
Colter, Jamison ;
Kinnison, Matthew ;
Henderson, Alex ;
Harbour, Steven .
2023 IEEE/AIAA 42ND DIGITAL AVIONICS SYSTEMS CONFERENCE, DASC, 2023,
[26]   DeepIDX: sophisticated IDS model using the generative adversarial network (GAN) algorithm [J].
Nurhadi Wijaya ;
Marselina Endah Hiswati ;
Sarah Anjani .
Iran Journal of Computer Science, 2022, 5 (3) :197-204
[27]   Generative adversarial network-based deep learning approach in classification of retinal conditions with optical coherence tomography images [J].
Ling-Chun Sun ;
Shu-I. Pao ;
Ke-Hao Huang ;
Chih-Yuan Wei ;
Ke-Feng Lin ;
Ping-Nan Chen .
Graefe's Archive for Clinical and Experimental Ophthalmology, 2023, 261 :1399-1412
[28]   A deep learning solution for particle size analysis in low resolution inline microscopy images based on generative adversarial network [J].
Vagenknecht, Martin ;
Soukup, Jindrich ;
Chen, Antong ;
Irizarry, Roberto .
POWDER TECHNOLOGY, 2023, 426
[29]   Generative adversarial network-based deep learning approach in classification of retinal conditions with optical coherence tomography images [J].
Sun, Ling-Chun ;
Pao, Shu-I. ;
Huang, Ke-Hao ;
Wei, Chih-Yuan ;
Lin, Ke-Feng ;
Chen, Ping-Nan .
GRAEFES ARCHIVE FOR CLINICAL AND EXPERIMENTAL OPHTHALMOLOGY, 2023, 261 (05) :1399-1412
[30]   Advancing Architectural Design Through Generative Adversarial Network Deep Learning Technology [J].
Huang, Yueming ;
He, Jianhua .
INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES, 2024, 15 (01)