ROI-Guided Attention Learning for Remote Sensing Image Retrieval

被引:1
作者
Li, Lili [1 ]
Xu, Guozheng [1 ]
Zhou, Xinyan [1 ]
Yao, Jian [1 ,2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430072, Peoples R China
[2] Wuhan Univ, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Image retrieval; Measurement; Deep learning; Accuracy; Task analysis; region of interest (ROI); remote sensing image; ROI-attention module; FEATURES; NETWORK; COLOR;
D O I
10.1109/JSTARS.2024.3421990
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the burgeoning remote sensing image data era, the swift and precise retrieval of images from extensive databases has emerged as a critical challenge. This need is particularly pronounced in applications, such as environmental and disaster monitoring, resource investigation, and ground target monitoring, all heavily reliant on remote sensing images. The efficacy of image retrieval hinges significantly on advanced feature extraction methods. However, remote sensing images often suffer from disturbances caused by rich and complex backgrounds. How to extract key regions from remote sensing images, reduce background interference, and improve retrieval accuracy has become a hot research topic. Addressing this challenge, in this article, we propose a region of interest (ROI) guided attention network designed to detect key category regions of targets. This network integrates a class activation map (CAM) module into a deep learning framework for image retrieval. First, the CAM identifies multiple categories corresponding to different remote sensing categories. Second, multiple category features are fed into an ROI-attention module to distinguish the importance of the category. The attention module highlights the category to be detected by suppressing interference from the background. Finally, two branches, the globally extracted image features and the locally extracted features of important categories obtained through the attention module, are integrated to form a comprehensive image representation optimized for retrieving the target object. The efficacy of our proposed method is validated through experiments conducted on diverse datasets, demonstrating an improvement in retrieval accuracy.
引用
收藏
页码:14752 / 14761
页数:10
相关论文
共 46 条
  • [1] Deep Learning for Instance Retrieval: A Survey
    Chen, Wei
    Liu, Yu
    Wang, Weiping
    Bakker, Erwin M.
    Georgiou, Theodoros
    Fieguth, Paul
    Liu, Li
    Lew, Michael S.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7270 - 7292
  • [2] Remote Sensing Image Scene Classification: Benchmark and State of the Art
    Cheng, Gong
    Han, Junwei
    Lu, Xiaoqiang
    [J]. PROCEEDINGS OF THE IEEE, 2017, 105 (10) : 1865 - 1883
  • [3] A Novel Ensemble Architecture of Residual Attention-Based Deep Metric Learning for Remote Sensing Image Retrieval
    Cheng, Qimin
    Gan, Deqiao
    Fu, Peng
    Huang, Haiyan
    Zhou, Yuzhuo
    [J]. REMOTE SENSING, 2021, 13 (17)
  • [4] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [5] El-Henawy I.M, 2016, Content-based image retrieval usingmultiresolution analysis of shape-based classified images
  • [6] Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval
    Fan, Lili
    Zhao, Hongwei
    Zhao, Haoyu
    [J]. REMOTE SENSING, 2020, 12 (01)
  • [7] Region-based cascade pooling of convolutional features for HRRS image retrieval
    Ge, Yun
    Tang, Yiling
    Jiang, Shunliang
    Leng, Lu
    Xu, Shaoping
    Ye, Famao
    [J]. REMOTE SENSING LETTERS, 2018, 9 (10) : 1002 - 1010
  • [8] Deep Image Retrieval: Learning Global Representations for Image Search
    Gordo, Albert
    Almazan, Jon
    Revaud, Jerome
    Larlus, Diane
    [J]. COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 : 241 - 257
  • [9] A Survey on Deep Learning-Driven Remote Sensing Image Scene Understanding: Scene Classification, Scene Retrieval and Scene-Guided Object Detection
    Gu, Yating
    Wang, Yantian
    Li, Yansheng
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (10):
  • [10] TEXTURAL FEATURES FOR IMAGE CLASSIFICATION
    HARALICK, RM
    SHANMUGAM, K
    DINSTEIN, I
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1973, SMC3 (06): : 610 - 621