Brain Computer Interface-Based Adaptive Automation to Prevent Out-Of-The-Loop Phenomenon in Air Traffic Controllers Dealing With Highly Automated Systems

被引:72
作者
Di Flumeri, Gianluca [1 ,2 ,3 ]
De Crescenzio, Francesca [4 ]
Berberian, Bruno [5 ]
Ohneiser, Oliver [6 ]
Kramer, Jan [6 ]
Arico, Pietro [1 ,2 ,3 ]
Borghini, Gianluca [1 ,2 ,3 ]
Babiloni, Fabio [1 ,3 ,7 ]
Bagassi, Sara [4 ]
Piastra, Sergio [4 ]
机构
[1] BrainSigns Srl, Rome, Italy
[2] IRCCS Fdn Santa Lucia, Neuroelect Imaging & BCI Lab, Rome, Italy
[3] Univ Rome Sapienza, Dept Mol Med, Rome, Italy
[4] Univ Bologna, Dept Ind Engn, Bologna, Italy
[5] Off Natl Etud & Rech Aerosp, French Aerosp Lab, Salon Air, France
[6] German Aerosp Ctr DLR, Braunschweig, Germany
[7] Hangzhou Dianzi Univ, Coll Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
基金
欧盟地平线“2020”;
关键词
efectroencephalography; eye-tracking; vigilance; Out-Of-The-Loop; passive brain-computer interface; adaptive automation; air traffic control; human-machine interface; MENTAL WORKLOAD; SITUATION AWARENESS; BIOCYBERNETIC SYSTEM; VIGILANCE DECREMENT; TASK ENGAGEMENT; PASSIVE BCI; ALPHA-BAND; PERFORMANCE; ATTENTION; ALERTNESS;
D O I
10.3389/fnhum.2019.00296
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Increasing the level of automation in air traffic management is seen as a measure to increase the performance of the service to satisfy the predicted future demand. This is expected to result in new roles for the human operator: he will mainly monitor highly automated systems and seldom intervene. Therefore, air traffic controllers (ATCos) would often work in a supervisory or control mode rather than in a direct operating mode. However, it has been demonstrated how human operators in such a role are affected by human performance issues, known as Out-Of-The-Loop (OOTL) phenomenon, consisting in lack of attention, loss of situational awareness and de-skilling. A countermeasure to this phenomenon has been identified in the adaptive automation (AA), i.e., a system able to allocate the operative tasks to the machine or to the operator depending on their needs. In this context, psychophysiological measures have been highlighted as powerful tool to provide a reliable, unobtrusive and real-time assessment of the ATCo's mental state to be used as control logic for AA-based systems. In this paper, it is presented the so-called "Vigilance and Attention Controller", a system based on electroencephalography (EEG) and eye-tracking (ET) techniques, aimed to assess in real time the vigilance level of an ATCo dealing with a highly automated human-machine interface and to use this measure to adapt the level of automation of the interface itself. The system has been tested on 14 professional ATCos performing two highly realistic scenarios, one with the system disabled and one with the system enabled. The results confirmed that (i) long high automated tasks induce vigilance decreasing and OOTL-related phenomena; (ii) EEG measures are sensitive to these kinds of mental impairments; and (iii) AA was able to counteract this negative effect by keeping the ATCo more involved within the operative task. The results were confirmed by EEG and ET measures as well as by performance and subjective ones, providing a clear example of potential applications and related benefits of AA.
引用
收藏
页数:17
相关论文
共 99 条
[31]   The Dry Revolution: Evaluation of Three Different EEG Dry Electrode Types in Terms of Signal Spectral Features, Mental States Classification and Usability [J].
Di Flumeri, Gianluca ;
Arico, Pietro ;
Borghini, Gianluca ;
Sciaraffa, Nicolina ;
Di Florio, Antonello ;
Babiloni, Fabio .
SENSORS, 2019, 19 (06)
[32]   EEG-Based Mental Workload Neurometric to Evaluate the Impact of Different Traffic and Road Conditions in Real Driving Settings [J].
Di Flumeri, Gianluca ;
Borghini, Gianluca ;
Arico, Pietro ;
Sciaraffa, Nicolina ;
Lanzi, Paola ;
Pozzi, Simone ;
Vignali, Valeria ;
Lantieri, Claudio ;
Bichicchi, Arianna ;
Simone, Andrea ;
Babiloni, Fabio .
FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
[33]  
Di Flumeri G, 2016, IEEE ENG MED BIO, P3187, DOI 10.1109/EMBC.2016.7591406
[34]   Individual differences in brain dynamics: important implications for the calculation of event-related band power [J].
Doppelmayr, M ;
Klimesch, W ;
Pachinger, T ;
Ripper, B .
BIOLOGICAL CYBERNETICS, 1998, 79 (01) :49-57
[35]   GAUSSIAN BEHAVIOR OF ELECTROENCEPHALOGRAM - CHANGES DURING PERFORMANCE OF MENTAL TASK [J].
ELUL, R .
SCIENCE, 1969, 164 (3877) :328-&
[36]   Level of automation effects on performance, situation awareness and workload in a dynamic control task [J].
Endsley, MR ;
Kaber, DB .
ERGONOMICS, 1999, 42 (03) :462-492
[37]   MEASUREMENT OF SITUATION AWARENESS IN DYNAMIC-SYSTEMS [J].
ENDSLEY, MR .
HUMAN FACTORS, 1995, 37 (01) :65-84
[38]   THE OUT-OF-THE-LOOP PERFORMANCE PROBLEM AND LEVEL OF CONTROL IN AUTOMATION [J].
ENDSLEY, MR ;
KIRIS, EO .
HUMAN FACTORS, 1995, 37 (02) :381-394
[39]  
Endsley MR, 1999, HUM FAC TRANSP, P257
[40]   Not so different after all: The same oscillatory processes support different types of attention [J].
Frey, Julia Natascha ;
Ruhnau, Philipp ;
Weisz, Nathan .
BRAIN RESEARCH, 2015, 1626 :183-197