Research on efficient detection network method for remote sensing images based on self attention mechanism

被引:0
|
作者
Li, Jing [1 ,2 ,3 ,4 ,5 ]
Wei, Xiaomeng [2 ,3 ]
机构
[1] Henan Univ Sci & Technol, Informat Engn Coll, Luoyang 471023, Peoples R China
[2] Henan Mech & Elect Vocat Coll, Sch Informat Enginering, Xinzheng 451192, Peoples R China
[3] Henan Mech & Elect Vocat Coll, Sch Internet Things, Xinzheng 451192, Peoples R China
[4] Henan Univ Sci & Technol, Henan Int Joint Lab Cyberspace Secur Applicat, Luoyang 471023, Peoples R China
[5] Henan Univ Sci Technol, Coll Informat Enginering, Luoyang 471000, Peoples R China
基金
美国国家科学基金会;
关键词
Computer vision; Remote sensing images; Image detection; Faster R-CNN; Self attention mechanism; End-to-end;
D O I
10.1016/j.imavis.2023.104884
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing images are widely used in aerial drones, satellites, and other fields. However, traditional object detection methods face challenges of low efficiency and accuracy due to the diverse scales, numerous target types, and complex backgrounds of remote sensing images. To address these issues, this paper proposes a remote sensing image detection network based on self-attention, which adaptively learns the relative importance of pixels to achieve more precise and efficient object detection in remote sensing images, meeting the demands of large-scale remote sensing image processing. Firstly, through end-to-end training, the object detection network is optimized as a whole to directly output detection results from the input remote sensing images, eliminating the need for additional intermediate steps. This not only reduces the impact of information loss and inconsistency but also simplifies the entire detection process. Secondly, we integrate the Faster R-CNN architecture as the foundation, combining region extraction and object classification into a unified process. Lastly, we embed selfattention mechanisms at different levels of the Faster R-CNN to progressively extract multi-scale and multilevel feature information, enhancing the network's ability to learn the correlation of information from different positions in the image, automatically capturing the relationships between objects, and improving the accuracy of object detection. This significantly reduces redundant computation, making it more efficient for large-scale remote sensing image processing. Experimental verification demonstrates that this approach outperforms traditional methods in terms of detection accuracy and efficiency, better addressing the particularities of remote sensing images, and providing an efficient and precise solution for aerial drone and satellite image processing. Remote sensing image detection has become one of the research hotspots in the field of remote sensing, holding significant theoretical significance and practical application value.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Building detection algorithm in multi-scale remote sensing images based on attention mechanism
    Ding, Wei
    Zhang, Li
    Yang, Guangliang
    EVOLUTIONARY INTELLIGENCE, 2023, 16 (05) : 1717 - 1728
  • [22] A fast self-attention cascaded network for object detection in large scene remote sensing images
    Hua, Xia
    Wang, Xinqing
    Rui, Ting
    Zhang, Haitao
    Wang, Dong
    APPLIED SOFT COMPUTING, 2020, 94 (94)
  • [23] Multigranularity Self-Attention Network for Fine-Grained Ship Detection in Remote Sensing Images
    Ouyang, Lihan
    Fang, Leyuan
    Ji, Xinyu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9722 - 9732
  • [24] Few-Shot Object Detection With Self-Adaptive Attention Network for Remote Sensing Images
    Xiao, Zixuan
    Qi, Jiahao
    Xue, Wei
    Zhong, Ping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4854 - 4865
  • [25] Attention-based pyramid decoder network for salient object detection in remote sensing images
    Liu, Yu
    Lin, Jie
    Yue, Gongtao
    Shao, Zhaosheng
    Zhang, Shanwen
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (04)
  • [26] HMCNet: Hybrid Efficient Remote Sensing Images Change Detection Network Based on Cross-Axis Attention MLP and CNN
    Wang, Liejun
    Li, Haojin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [27] Attention Mechanism Cloud Detection With Modified FCN for Infrared Remote Sensing Images
    Li, Liyuan
    Li, Xiaoyan
    Liu, Xin
    Huang, Wenwen
    Hu, Zhuoyue
    Chen, Fansheng
    IEEE ACCESS, 2021, 9 : 150975 - 150983
  • [28] CSA-CDGAN: channel self-attention-based generative adversarial network for change detection of remote sensing images
    Wang, Zhixue
    Zhang, Yu
    Luo, Lin
    Wang, Nan
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24): : 21999 - 22013
  • [29] CSA-CDGAN: channel self-attention-based generative adversarial network for change detection of remote sensing images
    Zhixue Wang
    Yu Zhang
    Lin Luo
    Nan Wang
    Neural Computing and Applications, 2022, 34 : 21999 - 22013
  • [30] River Segmentation of Remote Sensing Images Based on Composite Attention Network
    Fan, Zhiyong
    Hou, Jianmin
    Zang, Qiang
    Chen, Yunjie
    Yan, Fei
    COMPLEXITY, 2022, 2022