Improving synthetic media generation and detection using generative adversarial networks

被引:0
作者
Zia, Rabbia [1 ]
Rehman, Mariam [1 ]
Hussain, Afzaal [1 ]
Nazeer, Shahbaz [1 ]
Anjum, Maria [1 ,2 ]
机构
[1] Govt Coll Univ Faisalabad, Dept Microbiol, Faisalabad, Punjab, Pakistan
[2] Lahore Coll Women Univ, Dept Comp Sci, Lahore, Punjab, Pakistan
关键词
Generative adversarial networks; Deep neural networks; Image manipulation; DeepFake; Manipulation detection;
D O I
10.7717/peerj-cs.2181
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Synthetic images are created using computer graphics modeling and artificial intelligence techniques, referred to as deepfakes. They modify human features by using generative models and deep learning algorithms, posing risks violations of social media regulations and spread false information. To address these concerns, the study proposed an improved generative adversarial network (GAN) model which improves accuracy while differentiating between real and fake images focusing on data augmentation and label smoothing strategies for GAN training. The study utilizes a dataset containing human faces and employs DCGAN (deep convolutional generative adversarial network) as the base model. In comparison with the traditional GANs, the proposed GAN outperform in terms of frequently used metrics i.e., Fr & eacute;chet Inception Distance (FID) and accuracy. The model effectiveness is demonstrated through evaluation on the Flickr-Faces Nvidia dataset and Fakefaces dataset, achieving an FID score of 55.67, an accuracy of 98.82%, and an F1-score of 0.99 in detection. This study optimizes the model parameters to achieve optimal parameter settings. This study fine-tune the model parameters to reach optimal settings, thereby reducing risks in synthetic image generation. The article introduces an effective framework for both image manipulation and detection.
引用
收藏
页数:20
相关论文
共 31 条
  • [1] VirtualGAN: Reducing Mode Collapse in Generative Adversarial Networks Using Virtual Mapping
    Abusitta, Adel
    Wahab, Omar Abdel
    Fung, Benjamin C. M.
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [2] Improving Detection of DeepFakes through Facial Region Analysis in Images
    Alanazi, Fatimah
    Ushaw, Gary
    Morgan, Graham
    [J]. ELECTRONICS, 2024, 13 (01)
  • [3] DivGAN: A diversity enforcing generative adversarial network for mode collapse reduction
    Allahyani, Manal
    Alsulami, Rahaf
    Alwafi, Taif
    Alafif, Tarik
    Ammar, Heyfa
    Sabban, Sari
    Chen, Xuewen
    [J]. ARTIFICIAL INTELLIGENCE, 2023, 317
  • [4] Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network
    Arshed, Muhammad Asad
    Alwadain, Ayed
    Ali, Rao Faizan
    Mumtaz, Shahzad
    Ibrahim, Muhammad
    Muneer, Amgad
    [J]. MATHEMATICS, 2023, 11 (17)
  • [5] Adversarial Learning With Knowledge of Image Classification for Improving GANs
    Baek, Jae-Yong
    Yoo, Yong-Sang
    Bae, Seung-Hwan
    [J]. IEEE ACCESS, 2019, 7 : 56591 - 56605
  • [6] Stabilizing and Improving Training of Generative Adversarial Networks Through Identity Blocks and Modified Loss Function
    Fathallah, Mohamed
    Sakr, Mohamed
    Eletriby, Sherif
    [J]. IEEE ACCESS, 2023, 11 : 43276 - 43285
  • [7] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [8] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [9] Detecting GANs and Retouching based Digital Alterations via DAD-HCNN
    Jain, Anubhav
    Majumdar, Puspita
    Singh, Richa
    Vatsa, Mayank
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2870 - 2879
  • [10] DeepVision: Deepfakes Detection Using Human Eye Blinking Pattern
    Jung, Tackhyun
    Kim, Sangwon
    Kim, Keecheon
    [J]. IEEE ACCESS, 2020, 8 : 83144 - 83154