How do human detect targets of remote sensing images with visual attention?

被引:2
|
作者
He, Bing [1 ,2 ]
Qin, Tong [3 ]
Shi, Bowen [1 ,2 ]
Dong, Weihua [1 ,2 ]
机构
[1] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing Key Lab Remote Sensing Environm & Digital, Beijing 100875, Peoples R China
[2] Beijing Normal Univ, Fac Geog Sci, Beijing 100875, Peoples R China
[3] Univ Ghent, Dept Geog, Res Grp CartoGIS, B-9000 Ghent, Belgium
关键词
Remote sensing image; Visual attention; EEG; Eye tracking; Target detection; FEATURE-INTEGRATION-THEORY; OBJECT DETECTION; GUIDED SEARCH; MODEL; FEATURES;
D O I
10.1016/j.jag.2024.104044
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Human visual attention is the basis of target recognition, change detection and classification in remote sensing images. However, the human visual attention of remote sensing images during target detection remains uninvestigated. In this study, we simultaneously collected eye tracking and electroencephalography (EEG) data of 40 experts during target detection in 1000 remote sensing images. We quantified their attention in different phases of target detection (i.e., target search, selection, and identification) from their eye movements and brain activities. The eye-tracking results indicated that hue and lightness were crucial visual features that guided visual search for remote sensing images. The size of the target also affected the allocation of human attention resources. Particularly, participants tended to miss the targets that were smaller than 3.9 % of the whole image area. The fixation event-related potentials (FRPs) in temporal and parietal brain regions further distinguished the attention of targets and distractors, which could be attributed to the process of memory and processing. Our findings offer new visual and neural evidence for human attention in target detection of remote sensing images, which not only contribute to the performance of attention-based algorithms in remote sensing interpretation, but also provide an empirical basis for guiding human-machine intelligent fusion.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] YOLOv3 Object Detection Algorithm with Feature Pyramid Attention for Remote Sensing Images
    Cheng, Zhe
    Lv, Jingguo
    Wu, Anqi
    Qu, Ningning
    SENSORS AND MATERIALS, 2020, 32 (12) : 4537 - 4558
  • [32] Region of interest extraction based on multiscale visual saliency analysis for remote sensing images
    Zhang, Yinggang
    Zhang, Libao
    Yu, Xianchuan
    JOURNAL OF APPLIED REMOTE SENSING, 2015, 9
  • [33] Mutual Attention Inception Network for Remote Sensing Visual Question Answering
    Zheng, Xiangtao
    Wang, Binqiang
    Du, Xingqian
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] A Human-Computer Fusion Framework for Aircraft Recognition in Remote Sensing Images
    Li, Xiaobin
    Jiang, Bitao
    Wang, Shengjin
    Shen, Li
    Fu, Yuze
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) : 297 - 301
  • [35] Eye Fixation Related Cognitive Activities for Detecting Targets in Remote Sensing Images
    Wang, Xiaojuan
    Zeng, Ying
    Shu, Jun
    Zhang, Chi
    Yan, Bin
    2018 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND APPLICATIONS (ICCIA), 2018, : 171 - 174
  • [36] An Adaptive Multiscale Fusion Network Based on Regional Attention for Remote Sensing Images
    Lu, Wanzhen
    Liang, Longxue
    Wu, Xiaosuo
    Wang, Xiaoyu
    Cai, Jiali
    IEEE ACCESS, 2020, 8 : 107802 - 107813
  • [37] Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion
    Wei, Kai
    Huang, Xiaoxia
    Li, Hongga
    REMOTE SENSING, 2024, 16 (02)
  • [38] Military Aircraft Recognition Method Based on Attention Mechanism in Remote Sensing Images
    Liu, Kun
    Xu, Zhengfan
    Liu, Yang
    Xu, Guofeng
    IET Image Processing, 2025, 19 (01)
  • [39] Semantic Attention and Scale Complementary Network for Instance Segmentation in Remote Sensing Images
    Zhang, Tianyang
    Zhang, Xiangrong
    Zhu, Peng
    Tang, Xu
    Li, Chen
    Jiao, Licheng
    Zhou, Huiyu
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) : 10999 - 11013
  • [40] Small Object Detection in Remote Sensing Images Based on Feature Fusion and Attention
    Zhang Yin
    Zhu Guiyi
    Shi Tianjun
    Zhang Kun
    Yan Junhua
    ACTA OPTICA SINICA, 2022, 42 (24)