FCIHMRT: Feature Cross-Layer Interaction Hybrid Method Based on Res2Net and Transformer for Remote Sensing Scene Classification

被引:50
作者
Huo, Yan [1 ,2 ,3 ]
Gang, Shuang [1 ,2 ,3 ]
Guan, Chao [1 ,2 ,3 ]
机构
[1] Shenyang Univ, Inst Carbon Neutral Technol & Policy, Shenyang 110044, Peoples R China
[2] China Geol Survey, Northeast Geol S&T Innovat Ctr, Shenyang 110034, Peoples R China
[3] Minist Nat Resources, Key Lab Black Soil Evolut & Ecol Effect, Shenyang 110034, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
vision transformer; remote sensing image; Res2Net; scene classification; CONVOLUTIONAL NEURAL-NETWORK; ATTENTION; MODEL;
D O I
10.3390/electronics12204362
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Scene classification is one of the areas of remote sensing image processing that is gaining much attention. Aiming to solve the problem of the limited precision of optical scene classification caused by complex spatial patterns, a high similarity between classes, and a high diversity of classes, a feature cross-layer interaction hybrid algorithm for optical remote sensing scene classification is proposed in this paper. Firstly, a number of features are extracted from two branches, a vision transformer branch and a Res2Net branch, to strengthen the feature extraction capability of the strategy. A novel interactive attention technique is proposed, with the goal of focusing on the strong correlation between the two-branch features, to fully use the complementing advantages of the feature information. The retrieved feature data are further refined and merged. The combined characteristics are then employed for classification. The experiments were conducted by using three open-source remote sensing datasets to validate the feasibility of the proposed method, which performed better in scene classification tasks than other methods.
引用
收藏
页数:15
相关论文
共 48 条
  • [1] TPENAS: A Two-Phase Evolutionary Neural Architecture Search for Remote Sensing Image Classification
    Ao, Lei
    Feng, Kaiyuan
    Sheng, Kai
    Zhao, Hongyu
    He, Xin
    Chen, Zigang
    [J]. REMOTE SENSING, 2023, 15 (08)
  • [2] Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
  • [3] Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification
    Cao, Ran
    Fang, Leyuan
    Lu, Ting
    He, Nanjun
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (01) : 43 - 47
  • [4] Review of Image Classification Algorithms Based on Convolutional Neural Networks
    Chen, Leiyu
    Li, Shaobo
    Bai, Qiang
    Yang, Jing
    Jiang, Sanlong
    Miao, Yanming
    [J]. REMOTE SENSING, 2021, 13 (22)
  • [5] Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
    Cheng, Gong
    Xie, Xingxing
    Han, Junwei
    Guo, Lei
    Xia, Gui-Song
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 3735 - 3756
  • [6] Remote Sensing Image Scene Classification Using Bag of Convolutional Features
    Cheng, Gong
    Li, Zhenpeng
    Yao, Xiwen
    Guo, Lei
    Wei, Zhongliang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (10) : 1735 - 1739
  • [7] Convolutional Neural Network for Remote-Sensing Scene Classification: Transfer Learning Analysis
    de Lima, Rafael Pires
    Marfurt, Kurt
    [J]. REMOTE SENSING, 2020, 12 (01)
  • [8] A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification
    Deng, Peifang
    Huang, Hong
    Xu, Kejie
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [9] When CNNs Meet Vision Transformer: A Joint Framework for Remote Sensing Scene Classification
    Deng, Peifang
    Xu, Kejie
    Huang, Hong
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929