Using EEG and eye-tracking as indicators to investigate situation awareness variation during flight monitoring in air traffic control system

被引:1
作者
Li, Qinbiao [1 ]
Ng, Kam K. H. [1 ]
Yu, Simon C. M. [2 ]
Yiu, Cho Yin [1 ]
Li, Fan [1 ]
Chan, Felix T. S. [3 ]
机构
[1] Hong Kong Polytech Univ, Dept Aeronaut & Aviat Engn, Hong Kong, Peoples R China
[2] Khalifa Univ Sci & Technol, Dept Aerosp Engn, Abu Dhabi, U Arab Emirates
[3] Macau Univ Sci & Technol, Dept Decis Sci, Taipa, Peoples R China
关键词
ergonomics; aviation; EEG; eye-tracking; situation awareness; DECISION-MAKING; MENTAL WORKLOAD;
D O I
10.1017/S0373463325000037
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Identifying the absence of situation awareness (SA) in air traffic controllers is critical since it directly affects their hazard perception. This study aims to introduce and validate a multimodal methodology employing electroencephalogram (EEG) and eye-tracking to investigate SA variation within specific air traffic control contexts. Data from 28 participants executing the experiment involving three different SA-probe tests illustrated the conceptual relationship between EEG and eye-tracking indicators and SA variations, using behavioural data as a proxy. The results indicated that both EEG and eye-tracking metrics correlated positively with the SA levels required, that is, the frequency spectrum in the beta (13-30 Hz) and gamma (30-50 Hz) bands, alongside the fixation/saccade-based indicators and pupil dilation increased in response to higher SA levels. This research has substantial implications for investigating SA using a human-centric approach via psychophysiological indicators, revealing the intrinsic interactions between the human capability envelope and SA, contributing to the development of a real-time monitoring system of SA variations for air transportation safety research.
引用
收藏
页码:485 / 506
页数:22
相关论文
共 45 条
[21]   Single-pilot operations in commercial flight: Effects on neural activity and visual behaviour under abnormalities and emergencies [J].
Li, Qinbiao ;
Chen, Chun-Hsien ;
Ng, Kam K. H. ;
Yuan, Xin ;
Yiu, Cho Yin .
CHINESE JOURNAL OF AERONAUTICS, 2024, 37 (08) :277-292
[22]   Recognising situation awareness associated with different workloads using EEG and eye-tracking features in air traffic control tasks [J].
Li, Qinbiao ;
Ng, Kam K. H. ;
Yu, Simon C. M. ;
Yiu, Cho Yin ;
Lyu, Mengtao .
KNOWLEDGE-BASED SYSTEMS, 2023, 260
[23]   A human-centred approach based on functional near-infrared spectroscopy for adaptive decision-making in the air traffic control environment: A case study [J].
Li, Qinbiao ;
Ng, Kam K. H. ;
Fan, Zhijun ;
Yuan, Xin ;
Liu, Heshan ;
Bu, Lingguo .
ADVANCED ENGINEERING INFORMATICS, 2021, 49
[24]   Using eye-tracking to investigate the effects of pre-takeover visual engagement on situation awareness during automated driving [J].
Liang, Nade ;
Yang, Jing ;
Yu, Denny ;
Prakah-Asante, Kwaku O. ;
Curry, Reates ;
Blommer, Mike ;
Swaminathan, Radhakrishnan ;
Pitts, Brandon J. .
ACCIDENT ANALYSIS AND PREVENTION, 2021, 157
[25]   Take over! A video-clip study measuring attention, situation awareness, and decision-making in the face of an impending hazard [J].
Lu, Zhenji ;
Happee, Riender ;
de Winter, Joost C. F. .
TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2020, 72 :211-225
[26]   Leveraging eye-tracking technologies to promote aviation safety- A review of key aspects, challenges, and future perspectives [J].
Lyu, Mengtao ;
Fan, Li ;
Xu, Gangyan ;
Su, Han .
SAFETY SCIENCE, 2023, 168
[27]  
Mclntosh C., 2018, SITUATIONAL AWARENES
[28]   LOCALIZATION OF THE SOURCES OF EEG-DELTA, EEG-THETA, EEG-ALPHA AND EEG-BETA-FREQUENCY BANDS USING THE FFT DIPOLE APPROXIMATION [J].
MICHEL, CM ;
LEHMANN, D ;
HENGGELER, B ;
BRANDEIS, D .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1992, 82 (01) :38-44
[29]   A two-stage robust optimisation for terminal traffic flow problem [J].
Ng, K. K. H. ;
Lee, C. K. M. ;
Chan, Felix T. S. ;
Chen, Chun-Hsien ;
Qin, Yichen .
APPLIED SOFT COMPUTING, 2020, 89
[30]   Robust aircraft sequencing and scheduling problem with arrival/departure delay using the min-max regret approach [J].
Ng, K. K. H. ;
Lee, C. K. M. ;
Chan, Felix T. S. ;
Qin, Yichen .
TRANSPORTATION RESEARCH PART E-LOGISTICS AND TRANSPORTATION REVIEW, 2017, 106 :115-136