ObjectSeeker: Certifiably Robust Object Detection against Patch Hiding Attacks via Patch-agnostic Masking

被引:5
|
作者
Xiang, Chong [1 ]
Valtchanov, Alexander [1 ]
Mahloujifar, Saeed [1 ]
Mittal, Prateek [1 ]
机构
[1] Princeton Univ, Princeton, NJ 08544 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/SP46215.2023.10179319
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Object detectors, which are widely deployed in security-critical systems such as autonomous vehicles, have been found vulnerable to patch hiding attacks. An attacker can use a single physically-realizable adversarial patch to make the object detector miss the detection of victim objects and undermine the functionality of object detection applications. In this paper, we propose ObjectSeeker for certifiably robust object detection against patch hiding attacks. The key insight in ObjectSeeker is patch-agnostic masking: we aim to mask out the entire adversarial patch without knowing the shape, size, and location of the patch. This masking operation neutralizes the adversarial effect and allows any vanilla object detector to safely detect objects on the masked images. Remarkably, we can evaluate ObjectSeeker's robustness in a certifiable manner: we develop a certification procedure to formally determine if ObjectSeeker can detect certain objects against any white-box adaptive attack within the threat model, achieving certifiable robustness. Our experiments demonstrate a significant (similar to 10%40% absolute and similar to 2-6x relative) improvement in certifiable robustness over the prior work, as well as high clean performance (similar to 1% drop compared with undefended models).
引用
收藏
页码:1329 / 1347
页数:19
相关论文
共 30 条
  • [1] PAD: Patch-Agnostic Defense against Adversarial Patch Attacks
    Jing, Lihua
    Wang, Rui
    Ren, Wenqi
    Dong, Xin
    Zou, Cong
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 24472 - 24481
  • [2] Segment and Complete: Defending Object Detectors against Adversarial Patch Attacks with Robust Patch Detection
    Liu, Jiang
    Levine, Alexander
    Lau, Chun Pong
    Chellappa, Rama
    Feizi, Soheil
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14953 - 14962
  • [3] DetectorGuard: Provably Securing Object Detectors against Localized Patch Hiding Attacks
    Xiang, Chong
    Mittal, Prateek
    CCS '21: PROCEEDINGS OF THE 2021 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2021, : 3177 - 3196
  • [4] Adversarial patch attacks against aerial imagery object detectors
    Tang, Guijian
    Jiang, Tingsong
    Zhou, Weien
    Li, Chao
    Yao, Wen
    Zhao, Yong
    NEUROCOMPUTING, 2023, 537 : 128 - 140
  • [5] Towards a Robust Adversarial Patch Attack Against Unmanned Aerial Vehicles Object Detection
    Shrestha, Samridha
    Pathak, Saurabh
    Viegas, Eduardo K.
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 3256 - 3263
  • [6] Robust Object Tracking via Key Patch Sparse Representation
    He, Zhenyu
    Yi, Shuangyan
    Cheung, Yiu-Ming
    You, Xinge
    Tang, Yuan Yan
    IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (02) : 354 - 364
  • [7] Toward Robust Discriminative Projections Learning Against Adversarial Patch Attacks
    Wang, Zheng
    Nie, Feiping
    Wang, Hua
    Huang, Heng
    Wang, Fei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 18784 - 18798
  • [8] Threatening Patch Attacks on Object Detection in Optical Remote Sensing Images
    Sun, Xuxiang
    Cheng, Gong
    Pei, Lei
    Li, Hongda
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] CodeMosaic Patch: Physical Adversarial Attacks Against Infrared Aerial Object Detectors
    He, Hangwei
    Wu, Libing
    Wang, Enshu
    Wang, Yizhou
    Zhao, Yu
    PRICAI 2024: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2025, 15281 : 54 - 68
  • [10] Hardening RGB-D object recognition systems against adversarial patch attacks
    Zheng, Yang
    Demetrio, Luca
    Cina, Antonio Emanuele
    Feng, Xiaoyi
    Xia, Zhaoqiang
    Jiang, Xiaoyue
    Demontis, Ambra
    Biggio, Battista
    Roli, Fabio
    INFORMATION SCIENCES, 2023, 651