IMPROVING ROBUSTNESS TO OUT-OF-DISTRIBUTION DATA BY FREQUENCY-BASED AUGMENTATION

被引:6
|
作者
Mukai, Koki [1 ]
Kumano, Soichiro [1 ]
Yamasaki, Toshihiko [1 ]
机构
[1] Univ Tokyo, Tokyo, Japan
关键词
neural network; out-of-distribution; frequency; data augmentation;
D O I
10.1109/ICIP46576.2022.9897504
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Convolutional Neural Networks (CNNs) have high accuracy in image recognition, they are vulnerable to adversarial examples and out-of-distribution data, and the difference from human recognition has been pointed out. In order to improve the robustness against out-of-distribution data, we present a frequency-based data augmentation technique that replaces the frequency components with other images of the same class. When the training data are CIFAR10 and the out-of-distribution data are SVHN, the Area Under Receiver Operating Characteristic (AUROC) curve of the model trained with the proposed method increases from 89.22% to 98.15%, and further increased to 98.59% when combined with another data augmentation method. Furthermore, we experimentally demonstrate that the robust model for out-of-distribution data uses a lot of high-frequency components of the image.
引用
收藏
页码:3116 / 3120
页数:5
相关论文
共 50 条
  • [1] Improving Out-of-Distribution Robustness via Selective Augmentation
    Yao, Huaxiu
    Wang, Yu
    Li, Sai
    Zhang, Linjun
    Liang, Weixin
    Zou, James
    Finn, Chelsea
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [2] Generating Perturbation-based Explanations with Robustness to Out-of-Distribution Data
    Qiu, Luyu
    Yang, Yi
    Cao, Caleb Chen
    Zheng, Yueyuan
    Ngai, Hilary
    Hsiao, Janet
    Chen, Lei
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 3594 - 3605
  • [3] Graph Out-of-Distribution Generalization With Controllable Data Augmentation
    Lu, Bin
    Zhao, Ze
    Gan, Xiaoying
    Liang, Shiyu
    Fu, Luoyi
    Wang, Xinbing
    Zhou, Chenghu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6317 - 6329
  • [4] FreMix: Frequency-Based Mixup for Data Augmentation
    Xiu, Yang
    Zheng, Xinyi
    Sun, Linlin
    Fang, Zhuohao
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [5] An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
    Lin, Cheng-Hung
    Lin, Cheng-Shian
    Chou, Po-Yung
    Hsu, Chen-Chien
    IEEE ACCESS, 2021, 9 : 35313 - 35323
  • [6] On the Adversarial Robustness of Out-of-distribution Generalization Models
    Zou, Xin
    Liu, Weiwei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] MixOOD: Improving Out-of-distribution Detection with Enhanced Data Mixup
    Yang, Taocun
    Huang, Yaping
    Xie, Yanlin
    Liu, Junbo
    Wang, Shengchun
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (05)
  • [8] Out-of-Distribution Robustness with Deep Recursive Filters
    Katyal, Kapil D.
    Wang, I-Jeng
    Hager, Gregory D.
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 14134 - 14140
  • [9] Pretrained Transformers Improve Out-of-Distribution Robustness
    Hendrycks, Dan
    Liu, Xiaoyuan
    Wallace, Eric
    Dziedzic, Adam
    Krishnan, Rishabh
    Song, Dawn
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 2744 - 2751
  • [10] The Value of Out-of-Distribution Data
    De Silva, Ashwin
    Ramesh, Rahul
    Priebe, Carey E.
    Chaudhari, Pratik
    Vogelstein, Joshua T.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202