How do human detect targets of remote sensing images with visual attention?

被引:2
|
作者
He, Bing [1 ,2 ]
Qin, Tong [3 ]
Shi, Bowen [1 ,2 ]
Dong, Weihua [1 ,2 ]
机构
[1] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing Key Lab Remote Sensing Environm & Digital, Beijing 100875, Peoples R China
[2] Beijing Normal Univ, Fac Geog Sci, Beijing 100875, Peoples R China
[3] Univ Ghent, Dept Geog, Res Grp CartoGIS, B-9000 Ghent, Belgium
关键词
Remote sensing image; Visual attention; EEG; Eye tracking; Target detection; FEATURE-INTEGRATION-THEORY; OBJECT DETECTION; GUIDED SEARCH; MODEL; FEATURES;
D O I
10.1016/j.jag.2024.104044
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Human visual attention is the basis of target recognition, change detection and classification in remote sensing images. However, the human visual attention of remote sensing images during target detection remains uninvestigated. In this study, we simultaneously collected eye tracking and electroencephalography (EEG) data of 40 experts during target detection in 1000 remote sensing images. We quantified their attention in different phases of target detection (i.e., target search, selection, and identification) from their eye movements and brain activities. The eye-tracking results indicated that hue and lightness were crucial visual features that guided visual search for remote sensing images. The size of the target also affected the allocation of human attention resources. Particularly, participants tended to miss the targets that were smaller than 3.9 % of the whole image area. The fixation event-related potentials (FRPs) in temporal and parietal brain regions further distinguished the attention of targets and distractors, which could be attributed to the process of memory and processing. Our findings offer new visual and neural evidence for human attention in target detection of remote sensing images, which not only contribute to the performance of attention-based algorithms in remote sensing interpretation, but also provide an empirical basis for guiding human-machine intelligent fusion.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Comparative Study of Visual Attention Models with Human Eye Gaze in Remote Sensing Images
    Amudha, J.
    Radha, D.
    Deepa, A. S.
    PROCEEDING OF THE THIRD INTERNATIONAL SYMPOSIUM ON WOMEN IN COMPUTING AND INFORMATICS (WCI-2015), 2015, : 445 - 450
  • [2] Airport Detection in Remote Sensing Images Based on Visual Attention
    Wang, Xin
    Wang, Bin
    Zhang, Liming
    NEURAL INFORMATION PROCESSING, PT III, 2011, 7064 : 475 - 484
  • [3] Multiscale Visual Attention Networks for Object Detection in VHR Remote Sensing Images
    Wang, Chen
    Bai, Xiao
    Wang, Shuai
    Zhou, Jun
    Ren, Peng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (02) : 310 - 314
  • [4] Subtask Attention Based Object Detection in Remote Sensing Images
    Xiong, Shengzhou
    Tan, Yihua
    Li, Yansheng
    Wen, Cai
    Yan, Pei
    REMOTE SENSING, 2021, 13 (10)
  • [5] Visual Attention based Model for Target Detection in High Resolution Remote Sensing Images
    Ke, Xin
    He, Guojin
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER VISION IN REMOTE SENSING, 2012, : 84 - 89
  • [6] RNAF-YOLO: a model for highlighting difficult-to-detect targets in remote sensing images
    Wang, Manyi
    Gao, Weiwei
    Fang, Yu
    Liu, Xintian
    Jin, Xiaoyi
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (03)
  • [7] Ship Detection for Optical Remote Sensing Images Based on Visual Attention Enhanced Network
    Bi, Fukun
    Hou, Jinyuan
    Chen, Liang
    Yang, Zhihua
    Wang, Yanping
    SENSORS, 2019, 19 (10)
  • [8] Circular array targets detection from remote sensing images based on saliency detection
    Han, Xianwei
    Fu, Yili
    OPTICAL ENGINEERING, 2012, 51 (02)
  • [9] Efficient method for detecting targets from remote sensing images based on global attention mechanism
    Gao, Zijun
    Su, Jingwen
    Li, Bo
    Wang, Jue
    Song, Zhankui
    IET IMAGE PROCESSING, 2025, 19 (01)
  • [10] Learning to detect extreme objects for remote sensing images
    He, Qiang
    Li, Meng
    Huo, Lianzhi
    Chen, Linlin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (07) : 2719 - 2736