IMPROVING ROBUSTNESS TO OUT-OF-DISTRIBUTION DATA BY FREQUENCY-BASED AUGMENTATION

被引:6
|
作者
Mukai, Koki [1 ]
Kumano, Soichiro [1 ]
Yamasaki, Toshihiko [1 ]
机构
[1] Univ Tokyo, Tokyo, Japan
关键词
neural network; out-of-distribution; frequency; data augmentation;
D O I
10.1109/ICIP46576.2022.9897504
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Convolutional Neural Networks (CNNs) have high accuracy in image recognition, they are vulnerable to adversarial examples and out-of-distribution data, and the difference from human recognition has been pointed out. In order to improve the robustness against out-of-distribution data, we present a frequency-based data augmentation technique that replaces the frequency components with other images of the same class. When the training data are CIFAR10 and the out-of-distribution data are SVHN, the Area Under Receiver Operating Characteristic (AUROC) curve of the model trained with the proposed method increases from 89.22% to 98.15%, and further increased to 98.59% when combined with another data augmentation method. Furthermore, we experimentally demonstrate that the robust model for out-of-distribution data uses a lot of high-frequency components of the image.
引用
收藏
页码:3116 / 3120
页数:5
相关论文
共 50 条
  • [31] Improving Out-of-Distribution Detection by Learning from the Deployment Environment
    Inkawhich, Nathan
    Zhang, Jingyang
    Davis, Eric K.
    Luley, Ryan
    Chen, Yiran
    IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15 : 2070 - 2086
  • [32] Improving Out-of-Distribution Detection by Learning From the Deployment Environment
    Inkawhich, Nathan
    Zhang, Jingyang
    Davis, Eric K.
    Luley, Ryan
    Chen, Yiran
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 2070 - 2086
  • [33] Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models
    Zhou, Andy
    Wang, Jindong
    Wang, Yu-Xiong
    Wang, Haohan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [34] Ensemble-Based Out-of-Distribution Detection
    Yang, Donghun
    Mai Ngoc, Kien
    Shin, Iksoo
    Lee, Kyong-Ha
    Hwang, Myunggwon
    ELECTRONICS, 2021, 10 (05) : 1 - 12
  • [35] PoseExaminer: Automated Testing of Out-of-Distribution Robustness in Human Pose and Shape Estimation
    Liu, Qihao
    Kortylewski, Adam
    Yuille, Alan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 672 - 681
  • [36] A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness
    Diffenderfer, James
    Bartoldson, Brian R.
    Chaganti, Shreya
    Zhang, Jize
    Kailkhura, Bhavya
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [37] An Object Detection Model Robust to Out-of-Distribution Data
    Park, Ho-rim
    Hwang, Kyu-hong
    Ha, Young-guk
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2021), 2021, : 275 - 278
  • [38] Heatmap-based Out-of-Distribution Detection
    Hornauer, Julia
    Belagiannis, Vasileios
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2602 - 2611
  • [39] On Continual Model Refinement in Out-of-Distribution Data Streams
    Lin, Bill Yuchen
    Wang, Sida
    Lin, Xi Victoria
    Jia, Robin
    Xiao, Lin
    Ren, Xiang
    Yih, Wen-tau
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 3128 - 3139
  • [40] RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy & Out-of-Distribution Robustness
    Pinto, Francesco
    Yang, Harry
    Lim, Ser-Nam
    Torr, Philip H. S.
    Dokania, Puneet K.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,