Research on efficient detection network method for remote sensing images based on self attention mechanism

被引:0
|
作者
Li, Jing [1 ,2 ,3 ,4 ,5 ]
Wei, Xiaomeng [2 ,3 ]
机构
[1] Henan Univ Sci & Technol, Informat Engn Coll, Luoyang 471023, Peoples R China
[2] Henan Mech & Elect Vocat Coll, Sch Informat Enginering, Xinzheng 451192, Peoples R China
[3] Henan Mech & Elect Vocat Coll, Sch Internet Things, Xinzheng 451192, Peoples R China
[4] Henan Univ Sci & Technol, Henan Int Joint Lab Cyberspace Secur Applicat, Luoyang 471023, Peoples R China
[5] Henan Univ Sci Technol, Coll Informat Enginering, Luoyang 471000, Peoples R China
基金
美国国家科学基金会;
关键词
Computer vision; Remote sensing images; Image detection; Faster R-CNN; Self attention mechanism; End-to-end;
D O I
10.1016/j.imavis.2023.104884
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing images are widely used in aerial drones, satellites, and other fields. However, traditional object detection methods face challenges of low efficiency and accuracy due to the diverse scales, numerous target types, and complex backgrounds of remote sensing images. To address these issues, this paper proposes a remote sensing image detection network based on self-attention, which adaptively learns the relative importance of pixels to achieve more precise and efficient object detection in remote sensing images, meeting the demands of large-scale remote sensing image processing. Firstly, through end-to-end training, the object detection network is optimized as a whole to directly output detection results from the input remote sensing images, eliminating the need for additional intermediate steps. This not only reduces the impact of information loss and inconsistency but also simplifies the entire detection process. Secondly, we integrate the Faster R-CNN architecture as the foundation, combining region extraction and object classification into a unified process. Lastly, we embed selfattention mechanisms at different levels of the Faster R-CNN to progressively extract multi-scale and multilevel feature information, enhancing the network's ability to learn the correlation of information from different positions in the image, automatically capturing the relationships between objects, and improving the accuracy of object detection. This significantly reduces redundant computation, making it more efficient for large-scale remote sensing image processing. Experimental verification demonstrates that this approach outperforms traditional methods in terms of detection accuracy and efficiency, better addressing the particularities of remote sensing images, and providing an efficient and precise solution for aerial drone and satellite image processing. Remote sensing image detection has become one of the research hotspots in the field of remote sensing, holding significant theoretical significance and practical application value.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Remote Sensing Data Detection Based on Multiscale Fusion and Attention Mechanism
    Huang, Min
    Cheng, Cong
    De Luca, Gennaro
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [42] Enhanced Self-Attention Network for Remote Sensing Building Change Detection
    Liang, Shike
    Hua, Zhen
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4900 - 4915
  • [43] Remote sensing data detection based on multiscale fusion and attention mechanism
    Huang, Min
    Cheng, Cong
    De Luca, Gennaro
    Mobile Information Systems, 2021, 2021
  • [44] STCD: efficient Siamese transformers-based change detection method for remote sensing images
    Wang, Decheng
    Chen, Xiangning
    Guo, Ningbo
    Yi, Hui
    Li, Yinan
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (04): : 1192 - 1211
  • [45] Research on a ship target detection method in remote sensing images at sea
    Zhou, Weiping
    Huang, Shuai
    Luo, Qinjun
    Yu, Lisha
    International Journal of Information and Communication Technology, 2024, 25 (1-2) : 29 - 45
  • [46] An Adaptive Multiscale Fusion Network Based on Regional Attention for Remote Sensing Images
    Lu, Wanzhen
    Liang, Longxue
    Wu, Xiaosuo
    Wang, Xiaoyu
    Cai, Jiali
    IEEE ACCESS, 2020, 8 : 107802 - 107813
  • [47] A Semisupervised Siamese Network for Efficient Change Detection in Heterogeneous Remote Sensing Images
    Jiang, Xiao
    Li, Gang
    Zhang, Xiao-Ping
    He, You
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [48] Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
    Zhang, Qijian
    Cong, Runmin
    Li, Chongyi
    Cheng, Ming-Ming
    Fang, Yuming
    Cao, Xiaochun
    Zhao, Yao
    Kwong, Sam
    IEEE Transactions on Image Processing, 2021, 30 : 1305 - 1317
  • [49] Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
    Zhang, Qijian
    Cong, Runmin
    Li, Chongyi
    Cheng, Ming-Ming
    Fang, Yuming
    Cao, Xiaochun
    Zhao, Yao
    Kwong, Sam
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1305 - 1317
  • [50] Attention-Guided Siamese Fusion Network for Change Detection of Remote Sensing Images
    Chen, Puhua
    Guo, Lei
    Zhang, Xiangrong
    Qin, Kai
    Ma, Wentao
    Jiao, Licheng
    REMOTE SENSING, 2021, 13 (22)