Adversarially Robust Hyperspectral Image Classification via Random Spectral Sampling and Spectral Shape Encoding

被引:10
|
作者
Park, Sungjune [1 ]
Lee, Hong Joo [1 ]
Ro, Yong Man [1 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Sch Elect Engn, Daejeon 34141, South Korea
关键词
Training; Robustness; Spectral shape; Shape; Encoding; Feature extraction; Hyperspectral imaging; Adversarial robustness; hyperspectral image classification; random spectral sampling; spectral shape encoding; NEURAL-NETWORKS; ATTACKS; THREAT;
D O I
10.1109/ACCESS.2021.3076225
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although the hyperspectral image (HSI) classification has adopted deep neural networks (DNNs) and shown remarkable performances, there is a lack of studies of the adversarial vulnerability for the HSI classifications. In this paper, we propose a novel HSI classification framework robust to adversarial attacks. To this end, we focus on the unique spectral characteristic of HSIs (i.e., distinctive spectral patterns of materials). With the spectral characteristic, we present the random spectral sampling and spectral shape feature encoding for the robust HSI classification. For the random spectral sampling, spectral bands are randomly sampled from the entire spectrum for each pixel of the input HSI. Also, the overall spectral shape information, which is robust to adversarial attacks, is fed into the shape feature extractor to acquire the spectral shape feature. Then, the proposed framework can provide the adversarial robustness of HSI classifiers via randomization effects and spectral shape feature encoding. To the best of our knowledge, the proposed framework is the first work dealing with the adversarial robustness in the HSI classification. In experiments, we verify that our framework improves the adversarial robustness considerably under diverse adversarial attack scenarios, and outperforms the existing adversarial defense methods.
引用
收藏
页码:66791 / 66804
页数:14
相关论文
共 50 条
  • [1] Hyperspectral Image Classification Via Spectral-Spatial Random Patches Network
    Cheng, Chunbo
    Li, Hong
    Peng, Jiangtao
    Cui, Wenjing
    Zhang, Liming
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4753 - 4764
  • [2] Encoding Spectral and Spatial Context Information for Hyperspectral Image Classification
    Sun, Xin
    Zhou, Fei
    Dong, Junyu
    Gao, Feng
    Mu, Quanquan
    Wang, Xinhua
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (12) : 2250 - 2254
  • [3] Iterative Random Training Sampling Spectral Spatial Classification for Hyperspectral Images
    Chang, Chein-, I
    Ma, Kenneth Yeonkong
    Liang, Chia-Chen
    Kuo, Yi-Mei
    Chen, Shuhan
    Zhong, Shengwei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 3986 - 4007
  • [4] Spectral-Spatial Hyperspectral Image Classification via Robust Low-Rank Feature Extraction and Markov Random Field
    Cao, Xiangyong
    Xu, Zongben
    Meng, Deyu
    REMOTE SENSING, 2019, 11 (13)
  • [5] Hyperspectral Image Classification via Spectral Pooling and Hybrid Transformer
    Ma, Chen
    Jiang, Junjun
    Li, Huayi
    Mei, Xiaoguang
    Bai, Chengchao
    REMOTE SENSING, 2022, 14 (19)
  • [6] Hyperspectral Image Classification via Superpixel Spectral Metrics Representation
    Tu, Bing
    Kuang, Wenlan
    Zhao, Guangzhe
    Fei, Hongyan
    IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (10) : 1520 - 1524
  • [7] Improving hyperspectral image classification by combining spectral, texture, and shape features
    Mirzapour, Fardin
    Ghassemian, Hassan
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2015, 36 (04) : 1070 - 1096
  • [8] Spatial-Spectral Transformer With Conditional Position Encoding for Hyperspectral Image Classification
    Ahmad, Muhammad
    Usama, Muhammad
    Khan, Adil Mehmood
    Distefano, Salvatore
    Altuwaijri, Hamad Ahmed
    Mazzara, Manuel
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [9] A Spectral View of Adversarially Robust Features
    Garg, Shivam
    Sharan, Vatsal
    Zhang, Brian Hu
    Valiant, Gregory
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [10] On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification
    Liang, Jie
    Zhou, Jun
    Qian, Yuntao
    Wen, Lian
    Bai, Xiao
    Gao, Yongsheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (02): : 862 - 880