An End-to-End Local-Global-Fusion Feature Extraction Network for Remote Sensing Image Scene Classification

被引:41
|
作者
Lv, Yafei [1 ]
Zhang, Xiaohan [1 ]
Xiong, Wei [1 ]
Cui, Yaqi [1 ]
Cai, Mi [1 ]
机构
[1] Naval Aviat Univ, Res Inst Informat Fus, Yantai 264001, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing image scene classification (RSISC); Gated Recurrent Units (GRUs); discriminative feature representation; local feature; OBJECT DETECTION; SCALE;
D O I
10.3390/rs11243006
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Remote sensing image scene classification (RSISC) is an active task in the remote sensing community and has attracted great attention due to its wide applications. Recently, the deep convolutional neural networks (CNNs)-based methods have witnessed a remarkable breakthrough in performance of remote sensing image scene classification. However, the problem that the feature representation is not discriminative enough still exists, which is mainly caused by the characteristic of inter-class similarity and intra-class diversity. In this paper, we propose an efficient end-to-end local-global-fusion feature extraction (LGFFE) network for a more discriminative feature representation. Specifically, global and local features are extracted from channel and spatial dimensions respectively, based on a high-level feature map from deep CNNs. For the local features, a novel recurrent neural network (RNN)-based attention module is first proposed to capture the spatial layout information and context information across different regions. Gated recurrent units (GRUs) is then exploited to generate the important weight of each region by taking a sequence of features from image patches as input. A reweighed regional feature representation can be obtained by focusing on the key region. Then, the final feature representation can be acquired by fusing the local and global features. The whole process of feature extraction and feature fusion can be trained in an end-to-end manner. Finally, extensive experiments have been conducted on four public and widely used datasets and experimental results show that our method LGFFE outperforms baseline methods and achieves state-of-the-art results.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] FUSING DEEP LOCAL AND GLOBAL FEATURES FOR REMOTE SENSING IMAGE SCENE CLASSIFICATION
    Yan, Keli
    Mei, Shaohui
    Ma, Mingyang
    Yan, Feng
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3029 - 3032
  • [32] End-to-end feature fusion Siamese network for adaptive visual tracking
    Guo, Dongyan
    Wang, Jun
    Zhao, Weixuan
    Cui, Ying
    Wang, Zhenhua
    Chen, Shengyong
    IET IMAGE PROCESSING, 2021, 15 (01) : 91 - 100
  • [33] An end-to-end multi-resolution feature fusion defogging network
    Ping Xue
    ShiXiong Deng
    Signal, Image and Video Processing, 2023, 17 : 4189 - 4197
  • [34] An end-to-end multi-resolution feature fusion defogging network
    Xue, Ping
    Deng, ShiXiong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (08) : 4189 - 4197
  • [35] AN END-TO-END SCALABLE OBJECT DETECTION NETWORK FOR REMOTE SENSING IMAGES
    Duan, Yani
    Teng, Zhu
    Zhang, Baopeng
    Fan, Jianping
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 960 - 963
  • [36] Global guidance multi-feature fusion network based on remote sensing image road extraction
    Huan H.
    Sheng Y.
    Gu C.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (04): : 696 - 707
  • [37] An Attention Cascade Global-Local Network for Remote Sensing Scene Classification
    Shen, Junge
    Yu, Tianwei
    Yang, Haopeng
    Wang, Ruxin
    Wang, Qi
    REMOTE SENSING, 2022, 14 (09)
  • [38] An end-to-end multiple side-outputs fusion deep supervision network based remote sensing image change detection algorithm
    Wu, Xiaosuo
    Yang, Le
    Ma, Yaya
    Wu, Chaoyang
    Guo, Cunge
    Yan, Haowen
    Qiao, Ze
    Yao, Shuang
    Fan, Yufeng
    SIGNAL PROCESSING, 2023, 213
  • [39] Deep Feature Fusion for VHR Remote Sensing Scene Classification
    Chaib, Souleyman
    Liu, Huan
    Gu, Yanfeng
    Yao, Hongxun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08): : 4775 - 4784
  • [40] Bidirectional Adaptive Feature Fusion for Remote Sensing Scene Classification
    Ji, Weijun
    Li, Xuelong
    Lu, Xiaoqiang
    COMPUTER VISION, PT II, 2017, 772 : 486 - 497