Adversarial Examples for Preventing Diffusion Models from Malicious Image Edition

被引:0
作者
Guo, Mengjie [1 ,2 ]
Gai, Keke [1 ]
Yu, Jing [3 ]
机构
[1] Beijing Inst Technol, Sch Cyberspace Sci & Technol, Beijing 100081, Peoples R China
[2] Beijing Muguo Tech Ltd, Beijing 100081, Peoples R China
[3] Chinese Acad Sci, Inst Informat Engn, Beijing 100081, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2024 | 2024年 / 14886卷
基金
中国国家自然科学基金;
关键词
Adversarial Examples; Adversarial Perturbations; Latent Space; Diffusion Models; Latent Distribution;
D O I
10.1007/978-981-97-5498-4_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, with the advancement of artificial intelligence technology, Diffusion Models have become a prominent research direction, exhibiting remarkable proficiency in image generation tasks. However, the unrestricted utilization of Diffusion Models by infringers to illicitly edit unauthorized images has given rise to novel copyright challenges and privacy apprehensions. To address these issues, this paper introduces an adversarial sample-based approach that can significantly mitigate malicious image modifications by Diffusion Models. The key idea is to add imperceptible adversarial perturbations on the image, so that the representation of the disturbed image in the latent space is far away from the original image, thus effectively disrupting the editing operations of Diffusion Models and generating unrealistic pictures. A substantial volume of experimental results demonstrate the efficacy and robustness of this method.
引用
收藏
页码:373 / 385
页数:13
相关论文
共 22 条
  • [11] Salman H, 2023, arXiv
  • [12] Singer U, 2022, Arxiv, DOI arXiv:2209.14792
  • [13] Sohl-Dickstein J, 2015, PR MACH LEARN RES, V37, P2256
  • [14] Szegedy C, 2014, Arxiv, DOI [arXiv:1312.6199, DOI 10.1109/CVPR.2015.7298594]
  • [15] Tang YM, 2024, AAAI CONF ARTIF INTE, P5180
  • [16] Tang YM, 2023, Arxiv, DOI arXiv:2309.16141
  • [17] BDVFL: Blockchain-based Decentralized Vertical Federated Learning
    Wang, Shuo
    Gai, Keke
    Yu, Jing
    Zhu, Liehuang
    [J]. 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 628 - 637
  • [18] Image quality assessment: From error visibility to structural similarity
    Wang, Z
    Bovik, AC
    Sheikh, HR
    Simoncelli, EP
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) : 600 - 612
  • [19] Learning Dual Encoding Model for Adaptive Visual Understanding in Visual Dialogue
    Yu, Jing
    Jiang, Xiaoze
    Qin, Zengchang
    Zhang, Weifeng
    Hu, Yue
    Wu, Qi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 220 - 233
  • [20] Cross-modal knowledge reasoning for knowledge-based visual question answering
    Yu, Jing
    Zhu, Zihao
    Wang, Yujing
    Zhang, Weifeng
    Hu, Yue
    Tan, Jianlong
    [J]. PATTERN RECOGNITION, 2020, 108