How do human detect targets of remote sensing images with visual attention?

被引:2
|
作者
He, Bing [1 ,2 ]
Qin, Tong [3 ]
Shi, Bowen [1 ,2 ]
Dong, Weihua [1 ,2 ]
机构
[1] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing Key Lab Remote Sensing Environm & Digital, Beijing 100875, Peoples R China
[2] Beijing Normal Univ, Fac Geog Sci, Beijing 100875, Peoples R China
[3] Univ Ghent, Dept Geog, Res Grp CartoGIS, B-9000 Ghent, Belgium
关键词
Remote sensing image; Visual attention; EEG; Eye tracking; Target detection; FEATURE-INTEGRATION-THEORY; OBJECT DETECTION; GUIDED SEARCH; MODEL; FEATURES;
D O I
10.1016/j.jag.2024.104044
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Human visual attention is the basis of target recognition, change detection and classification in remote sensing images. However, the human visual attention of remote sensing images during target detection remains uninvestigated. In this study, we simultaneously collected eye tracking and electroencephalography (EEG) data of 40 experts during target detection in 1000 remote sensing images. We quantified their attention in different phases of target detection (i.e., target search, selection, and identification) from their eye movements and brain activities. The eye-tracking results indicated that hue and lightness were crucial visual features that guided visual search for remote sensing images. The size of the target also affected the allocation of human attention resources. Particularly, participants tended to miss the targets that were smaller than 3.9 % of the whole image area. The fixation event-related potentials (FRPs) in temporal and parietal brain regions further distinguished the attention of targets and distractors, which could be attributed to the process of memory and processing. Our findings offer new visual and neural evidence for human attention in target detection of remote sensing images, which not only contribute to the performance of attention-based algorithms in remote sensing interpretation, but also provide an empirical basis for guiding human-machine intelligent fusion.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Using Layered Object Representation to Detect Partially Visible Airplanes in Remote Sensing Images
    Qiu, Shaohua
    Wen, Gongjian
    Fan, Yaxiang
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), VOL 1, 2016, : 159 - 163
  • [43] Automatic Hiding Method of Sensitive Targets in Remote Sensing Images Based on Transformer Structure
    Li P.
    Bai W.
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2022, 47 (08): : 1287 - 1297
  • [44] Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
    Zhang, Qijian
    Cong, Runmin
    Li, Chongyi
    Cheng, Ming-Ming
    Fang, Yuming
    Cao, Xiaochun
    Zhao, Yao
    Kwong, Sam
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1305 - 1317
  • [45] An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images
    Ye, Yuanxin
    Ren, Xiaoyue
    Zhu, Bai
    Tang, Tengfeng
    Tan, Xin
    Gui, Yang
    Yao, Qin
    REMOTE SENSING, 2022, 14 (03)
  • [46] Feature reassembly and self-attention for oriented object detection in remote sensing images
    Min L.
    Fan Z.
    Xie X.
    Lyu Q.
    National Remote Sensing Bulletin, 2023, 27 (12) : 2716 - 2725
  • [47] Center-Boundary Dual Attention for Oriented Object Detection in Remote Sensing Images
    Liu, Shuai
    Zhang, Lu
    Lu, Huchuan
    He, You
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [48] Multi-attention Integration Mechanism for Region Destruction Detection of Remote Sensing Images
    Sun, Hang
    Sun, Yunyun
    Li, Peng
    Xu, He
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT III, 2024, 14497 : 198 - 210
  • [49] Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
    Tian, Zhuangzhuang
    Zhan, Ronghui
    Hu, Jiemin
    Wang, Wei
    He, Zhiqiang
    Zhuang, Zhaowen
    REMOTE SENSING, 2020, 12 (15)
  • [50] RAF-Net: Residual Attention Fusion for Object Detection in Remote Sensing Images
    Yang, Xinxiu
    Feng, Zhengyong
    Ren, Wenjie
    Liu, Ying
    Miao, Jinchao
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 79 - 83