Brain Computer Interface-Based Adaptive Automation to Prevent Out-Of-The-Loop Phenomenon in Air Traffic Controllers Dealing With Highly Automated Systems

被引:72
作者
Di Flumeri, Gianluca [1 ,2 ,3 ]
De Crescenzio, Francesca [4 ]
Berberian, Bruno [5 ]
Ohneiser, Oliver [6 ]
Kramer, Jan [6 ]
Arico, Pietro [1 ,2 ,3 ]
Borghini, Gianluca [1 ,2 ,3 ]
Babiloni, Fabio [1 ,3 ,7 ]
Bagassi, Sara [4 ]
Piastra, Sergio [4 ]
机构
[1] BrainSigns Srl, Rome, Italy
[2] IRCCS Fdn Santa Lucia, Neuroelect Imaging & BCI Lab, Rome, Italy
[3] Univ Rome Sapienza, Dept Mol Med, Rome, Italy
[4] Univ Bologna, Dept Ind Engn, Bologna, Italy
[5] Off Natl Etud & Rech Aerosp, French Aerosp Lab, Salon Air, France
[6] German Aerosp Ctr DLR, Braunschweig, Germany
[7] Hangzhou Dianzi Univ, Coll Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
基金
欧盟地平线“2020”;
关键词
efectroencephalography; eye-tracking; vigilance; Out-Of-The-Loop; passive brain-computer interface; adaptive automation; air traffic control; human-machine interface; MENTAL WORKLOAD; SITUATION AWARENESS; BIOCYBERNETIC SYSTEM; VIGILANCE DECREMENT; TASK ENGAGEMENT; PASSIVE BCI; ALPHA-BAND; PERFORMANCE; ATTENTION; ALERTNESS;
D O I
10.3389/fnhum.2019.00296
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Increasing the level of automation in air traffic management is seen as a measure to increase the performance of the service to satisfy the predicted future demand. This is expected to result in new roles for the human operator: he will mainly monitor highly automated systems and seldom intervene. Therefore, air traffic controllers (ATCos) would often work in a supervisory or control mode rather than in a direct operating mode. However, it has been demonstrated how human operators in such a role are affected by human performance issues, known as Out-Of-The-Loop (OOTL) phenomenon, consisting in lack of attention, loss of situational awareness and de-skilling. A countermeasure to this phenomenon has been identified in the adaptive automation (AA), i.e., a system able to allocate the operative tasks to the machine or to the operator depending on their needs. In this context, psychophysiological measures have been highlighted as powerful tool to provide a reliable, unobtrusive and real-time assessment of the ATCo's mental state to be used as control logic for AA-based systems. In this paper, it is presented the so-called "Vigilance and Attention Controller", a system based on electroencephalography (EEG) and eye-tracking (ET) techniques, aimed to assess in real time the vigilance level of an ATCo dealing with a highly automated human-machine interface and to use this measure to adapt the level of automation of the interface itself. The system has been tested on 14 professional ATCos performing two highly realistic scenarios, one with the system disabled and one with the system enabled. The results confirmed that (i) long high automated tasks induce vigilance decreasing and OOTL-related phenomena; (ii) EEG measures are sensitive to these kinds of mental impairments; and (iii) AA was able to counteract this negative effect by keeping the ATCo more involved within the operative task. The results were confirmed by EEG and ET measures as well as by performance and subjective ones, providing a clear example of potential applications and related benefits of AA.
引用
收藏
页数:17
相关论文
共 99 条
[1]   Portable Weather Applications for General Aviation Pilots [J].
Ahlstrom, Ulf ;
Ohneiser, Oliver ;
Caddigan, Eamon .
HUMAN FACTORS, 2016, 58 (06) :864-885
[2]  
[Anonymous], ANN REP ICAO COUNC 2
[3]  
Antonacci Y, 2017, IEEE ENG MED BIO, P4351, DOI 10.1109/EMBC.2017.8037819
[4]   Passive BCI beyond the lab: current trends and future directions [J].
Arico, P. ;
Borghini, G. ;
Di Flumeri, G. ;
Sciaraffa, N. ;
Babiloni, F. .
PHYSIOLOGICAL MEASUREMENT, 2018, 39 (08)
[5]   A passive brain-computer interface application for the mental workload assessment on professional air traffic controllers during realistic air traffic control tasks [J].
Arico, P. ;
Borghini, G. ;
Di Flumeri, G. ;
Colosimo, A. ;
Pozzi, S. ;
Babiloni, F. .
BRAIN-COMPUTER INTERFACES: LAB EXPERIMENTS TO REAL-WORLD APPLICATIONS, 2016, 228 :295-328
[6]  
Arico P, 2017, US Patent, Patent No. [EP3143933A1, 3143933]
[7]   Human Factors and Neurophysiological Metrics in Air Traffic Control: A Critical Review [J].
Aricò P. ;
Borghini G. ;
Di Flumeri G. ;
Bonelli S. ;
Golfetti A. ;
Graziani I. ;
Pozzi S. ;
Imbert J.-P. ;
Granger G. ;
Benhacene R. ;
Schaefer D. ;
Babiloni F. .
IEEE Reviews in Biomedical Engineering, 2017, 10 :250-263
[8]   Passive BCI in Operational Environments: Insights, Recent Advances, and Future Trends [J].
Arico, Pietro ;
Borghini, Gianluca ;
Di Flumeri, Gianluca ;
Sciaraffa, Nicolina ;
Colosimo, Alfredo ;
Babiloni, Fabio .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (07) :1431-1436
[9]   Adaptive Automation Triggered by EEG-Based Mental Workload Index: A Passive Brain-Computer Interface Application in Realistic Air Traffic Control Environment [J].
Arico, Pietro ;
Borghini, Gianluca ;
Di Flumeri, Gianluca ;
Colosimo, Alfredo ;
Bonelli, Stefano ;
Golfetti, Alessia ;
Pozzi, Simone ;
Imbert, Jean-Paul ;
Granger, Geraud ;
Benhacene, Railane ;
Babiloni, Fabio .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[10]   Tracking users' visual attention and responses to personalized advertising based on task cognitive demand [J].
Bang, Hyejin ;
Wojdynski, Bartosz W. .
COMPUTERS IN HUMAN BEHAVIOR, 2016, 55 :867-876