PCCN-MSS: Parallel Convolutional Classification Network Combined Multi-Spatial Scale and Spectral Features for UAV-Borne Hyperspectral With High Spatial Resolution Imagery

被引:3
|
作者
Jiang, Linhuan [1 ,2 ]
Zhang, Zhen [1 ,2 ]
Tang, Bo-Hui [1 ,2 ,3 ]
Huang, Lehao [1 ,2 ]
Zhang, Bingru [1 ,2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Land Resource Engn, Kunming 650093, Peoples R China
[2] Yunnan Prov Dept Educ, Key Lab Plateau Remote Sensing, Kunming 650093, Peoples R China
[3] Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, State Key Lab Resources & Environm Informat Syst, Beijing 100101, Peoples R China
关键词
Feature extraction; Convolutional neural networks; Hyperspectral imaging; Data mining; Computational modeling; Autonomous aerial vehicles; Convolution; Feature pyramid networks (FPNs); image classification; parallel convolutional classification network; spectral attention (SA); unmanned aerial vehicle (UAV)-borne hyperspectral imagery; ATTENTION NETWORK; FUSION;
D O I
10.1109/JSTARS.2024.3370632
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hyperspectral remote sensing images with high spatial resolution (H-2 imagery) have an abundant spatial-spectral information, holding tremendous potential for remote sensing fine-grained monitoring and classification. However, challenges such as high spatial heterogeneity, severe intra-class spectral variability, and poor signal-to-noise ratio especially in unmanned aerial vehicle (UAV) hyperspectral imagery constrain and hinder the performance of fine-grained classification. Convolutional neural network (CNN) emerges as a formidable and excellent tool for image mining and feature extraction, offering effective utility for land cover classification. In this article, a parallel convolutional classification network model based on multimodal filters [including independent component analysis (ICA)-two-dimensional (2-D)-FPN and spectral attention (SA)-3-D-CNN branching structures] PCCN-MSS is proposed for precise H-2 imagery classification. The ICA-2-D-FPN branch integrates ICA into 2-D-CNN to extract the multispatial scale and spectral information of H-2 imagery by feature pyramid networks, meanwhile, the SA-3-D-CNN branch is designed to extract the spatial and spectral information by combining SA mechanism and 3-D-CNN. Taking hyperspectral imagery of UAVs containing vegetation and artifactual material ground as an example, the proposed PCCN-MSS model achieves an overall accuracy of 78.18%, which outperforms by 9.58% to the compared methods. The proposed PCCN-MSS method can mitigate the classification issues of severe salt-and-pepper noise and inaccurate boundary, delivering more satisfactory classification results with robust classification performance and remarkable advantages for H-2 imagery.
引用
收藏
页码:6529 / 6543
页数:15
相关论文
共 14 条
  • [1] SPNet: Spectral Patching End-to-End Classification Network for UAV-Borne Hyperspectral Imagery With High Spatial and Spectral Resolutions
    Hu, Xin
    Zhong, Yanfei
    Wang, Xinyu
    Luo, Chang
    Zhao, Ji
    Lei, Lei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Spatial-Spectral Fusion Based on Conditional Random Fields for the Fine Classification of Crops in UAV-Borne Hyperspectral Remote Sensing Imagery
    Wei, Lifei
    Yu, Ming
    Zhong, Yanfei
    Zhao, Ji
    Liang, Yajing
    Hu, Xin
    REMOTE SENSING, 2019, 11 (07)
  • [3] Study of Spatial-Spectral Feature Extraction Frameworks With 3-D Convolutional Neural Network for Robust Hyperspectral Imagery Classification
    Praveen, Bishwas
    Menon, Vineetha
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 (14) : 1717 - 1727
  • [4] Novel Adaptive Region Spectral-Spatial Features for Land Cover Classification With High Spatial Resolution Remotely Sensed Imagery
    Lv, Zhiyong
    Zhang, Pengfei
    Sun, Weiwei
    Benediktsson, Jon Atli
    Li, Junhuai
    Wang, Wei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [5] WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRF
    Zhong, Yanfei
    Hu, Xin
    Luo, Chang
    Wang, Xinyu
    Zhao, Ji
    Zhang, Liangpei
    REMOTE SENSING OF ENVIRONMENT, 2020, 250 (250)
  • [6] Multi-Scale Spatial-Spectral Residual Attention Network for Hyperspectral Image Classification
    Wu, Qinggang
    He, Mengkun
    Liu, Zhongchi
    Liu, Yanyan
    ELECTRONICS, 2024, 13 (02)
  • [7] Multi-scale spectral-spatial dual-transformer network for hyperspectral image classification
    Pan, Zhaojie
    Ding, Sunjinyan
    Sun, Genyun
    Zhang, Aizhu
    Jia, Xiuping
    Fu, Hang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (07) : 2480 - 2494
  • [8] Spectral-Spatial Classification of Few Shot Hyperspectral Image With Deep 3-D Convolutional Random Fourier Features Network
    Wang, Tingting
    Liu, Huanyu
    Li, Junbao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] A Spatial-Spectral Transformer for Hyperspectral Image Classification Based on Global Dependencies of Multi-Scale Features
    Ma, Yunxuan
    Lan, Yan
    Xie, Yakun
    Yu, Lanxin
    Chen, Chen
    Wu, Yusong
    Dai, Xiaoai
    REMOTE SENSING, 2024, 16 (02)
  • [10] An attention-driven convolutional neural network-based multi-level spectral-spatial feature learning for hyperspectral image classification
    Pu, Chunyu
    Huang, Hong
    Yang, Liping
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 185