Adversarial Examples for Preventing Diffusion Models from Malicious Image Edition

被引:0
作者
Guo, Mengjie [1 ,2 ]
Gai, Keke [1 ]
Yu, Jing [3 ]
机构
[1] Beijing Inst Technol, Sch Cyberspace Sci & Technol, Beijing 100081, Peoples R China
[2] Beijing Muguo Tech Ltd, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Inst Informat Engn, Beijing 100081, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2024 | 2024年 / 14886卷
基金
中国国家自然科学基金;
关键词
Adversarial Examples; Adversarial Perturbations; Latent Space; Diffusion Models; Latent Distribution;
D O I
10.1007/978-981-97-5498-4_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, with the advancement of artificial intelligence technology, Diffusion Models have become a prominent research direction, exhibiting remarkable proficiency in image generation tasks. However, the unrestricted utilization of Diffusion Models by infringers to illicitly edit unauthorized images has given rise to novel copyright challenges and privacy apprehensions. To address these issues, this paper introduces an adversarial sample-based approach that can significantly mitigate malicious image modifications by Diffusion Models. The key idea is to add imperceptible adversarial perturbations on the image, so that the representation of the disturbed image in the latent space is far away from the original image, thus effectively disrupting the editing operations of Diffusion Models and generating unrealistic pictures. A substantial volume of experimental results demonstrate the efficacy and robustness of this method.
引用
收藏
页码:373 / 385
页数:13
相关论文
共 22 条
  • [1] Biggio B., 2013, ECML PKDD, DOI [10.1007/978-3-642-40994-3_25, DOI 10.1007/978-3-642-40994-3_25]
  • [2] Dhariwal P, 2021, ADV NEUR IN, V34
  • [3] Hensel M, 2017, ADV NEUR IN, V30
  • [4] CLIP-Mesh: Generating textured meshes from text using pretrained image-text models
    Khalid, Nasir Mohammad
    Xie, Tianhao
    Belilovsky, Eugene
    Popa, Tiberiu
    [J]. PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [5] hfficiency-enhanced Blockchain-based Client Selection in Heterogeneous Federated Learning
    Lei, Zhiqi
    Gai, Keke
    Yu, Jing
    Wang, Shuo
    Zhu, Liehuang
    Choo, Kim-Kwang Raymond
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN, BLOCKCHAIN, 2023, : 289 - 296
  • [6] Liang CM, 2023, Arxiv, DOI arXiv:2302.04578
  • [7] Nichol A, 2022, Arxiv, DOI arXiv:2112.10741
  • [8] Radford A, 2021, PR MACH LEARN RES, V139
  • [9] High-Resolution Image Synthesis with Latent Diffusion Models
    Rombach, Robin
    Blattmann, Andreas
    Lorenz, Dominik
    Esser, Patrick
    Ommer, Bjoern
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10674 - 10685
  • [10] Saharia C, 2022, ADV NEUR IN