LogoStyleFool: Vitiating Video Recognition Systems via Logo Style Transfer

被引:0
作者
Cao, Yuxin [1 ]
Zhao, Ziyu [2 ]
Xiao, Xi [1 ]
Wang, Derui [3 ]
Xue, Minhui [3 ]
Lu, Jin [4 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
[2] Beijing Univ Technol, Fan Gongxiu Honors Coll, Beijing, Peoples R China
[3] CSIROs Data61, Eveleigh, NSW, Australia
[4] Ping Technol Shenzhen Co Ltd, Shenzhen, Peoples R China
来源
THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2 | 2024年
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video recognition systems are vulnerable to adversarial examples. Recent studies show that style transfer-based and patch-based unrestricted perturbations can effectively improve attack efficiency. These attacks, however, face two main challenges: 1) Adding large stylized perturbations to all pixels reduces the naturalness of the video and such perturbations can be easily detected. 2) Patch-based video attacks are not extensible to targeted attacks due to the limited search space of reinforcement learning that has been widely used in video attacks recently. In this paper, we focus on the video blackbox setting and propose a novel attack framework named LogoStyleFool by adding a stylized logo to the clean video. We separate the attack into three stages: style reference selection, reinforcement-learning-based logo style transfer, and perturbation optimization. We solve the first challenge by scaling down the perturbation range to a regional logo, while the second challenge is addressed by complementing an optimization stage after reinforcement learning. Experimental results substantiate the overall superiority of LogoStyleFool over three state-of-the-art patch-based attacks in terms of attack performance and semantic preservation. Meanwhile, LogoStyleFool still maintains its performance against two existing patch-based defense methods. We believe that our research is beneficial in increasing the attention of the security community to such subregional style transfer attacks.
引用
收藏
页码:945 / 953
页数:9
相关论文
共 50 条
  • [41] Video style transfer by consistent adaptive patch sampling
    Frigo, Oriel
    Sabater, Neus
    Delon, Julie
    Hellier, Pierre
    VISUAL COMPUTER, 2019, 35 (03) : 429 - 443
  • [42] Video Style Transfer based on Convolutional Neural Networks
    Dong, Sun
    Ding, Youdong
    Qian, Yun
    Li, Mengfan
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [43] Unpaired Motion Style Transfer from Video to Animation
    Aberman, Kfir
    Weng, Yijia
    Lischinski, Dani
    Cohen-Or, Daniel
    Chen, Baoquan
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (04):
  • [44] Image Style Transfer via Multi-Style Geometry Warping
    Alexandru, Ioana
    Nicula, Constantin
    Prodan, Cristian
    Rotaru, Razvan-Paul
    Tarba, Nicolae
    Boiangiu, Costin-Anton
    APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [45] Visual Design Reuse Through Style Recognition and Transfer
    Warner, Jeremy
    ADJUNCT PROCEEDINGS OF THE 34TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST 2021, 2021, : 175 - 178
  • [46] Synthesizing Scene Text Images for Recognition with Style Transfer
    Liu, Haoran
    Zhu, Anna
    2019 INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION WORKSHOPS (ICDARW), VOL 5, 2019, : 8 - 13
  • [47] Similarity constraint style transfer mapping for emotion recognition
    Chen, Lei
    She, Qingshan
    Meng, Ming
    Zhang, Qizhong
    Zhang, Jianhai
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 80
  • [48] Caster: Cartoon style transfer via dynamic cartoon style casting
    Zhang, Zhanjie
    Sun, Jiakai
    Chen, Jiafu
    Zhao, Lei
    Ji, Boyan
    Lan, Zehua
    Li, Guangyuan
    Xing, Wei
    Xu, Duanqing
    NEUROCOMPUTING, 2023, 556
  • [49] Unsupervised Style Transfer in News Headlines via Discrete Style Space
    Liu, Qianhui
    Gao, Yang
    Yang, Yizhe
    CHINESE COMPUTATIONAL LINGUISTICS, CCL 2023, 2023, 14232 : 91 - 105
  • [50] Multi-Source Style Transfer via Style Disentanglement Network
    Wang, Quan
    Li, Sheng
    Wang, Zichi
    Zhang, Xinpeng
    Feng, Guorui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1373 - 1383