Identification and classification of construction equipment operators' mental fatigue using wearable eye-tracking technology

被引:126
作者
Li, Jue [1 ,2 ]
Li, Heng [2 ]
Umer, Waleed [3 ]
Wang, Hongwei [4 ]
Xing, Xuejiao [2 ,5 ]
Zhao, Shukai [6 ]
Hou, Jun [7 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan, Hubei, Peoples R China
[2] Hong Kong Polytech Univ, Dept Bldg & Real Estate, Hung Hom, Kowloon, Hong Kong, Peoples R China
[3] King Fahd Univ Petr & Minerals, Construct Engn & Management, Dhahran, Saudi Arabia
[4] Huazhong Univ Sci & Technol, Sch Management, Wuhan, Hubei, Peoples R China
[5] Huazhong Univ Sci & Technol, Sch Civil Engn & Mech, Wuhan, Hubei, Peoples R China
[6] Shenzhen Hailong Construct Technol Co Ltd, Shenzhen, Guangdong, Peoples R China
[7] Chongqing China State Hailong Liangjiang Construc, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Mental fatigue identification and classification; Construction equipment operator; Eye-tracking; Machine learning; Toeplitz Inverse Covariance-Based Clustering; ATTENTION; RISK; RECOGNITION; VALIDATION; MANAGEMENT; SLEEPINESS; SIGNALS; STRESS; SYSTEM; SAFETY;
D O I
10.1016/j.autcon.2019.103000
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In the construction industry, the operator's mental fatigue is one of the most important causes of construction equipment-related accidents. Mental fatigue can easily lead to poor performance of construction equipment operations and accidents in the worst case scenario. Hence, it is necessary to propose an objective method that can accurately detect multiple levels of mental fatigue of construction equipment operators. To address such issue, this paper develops a novel method to identify and classify operator's multi-level mental fatigue using wearable eye-tracking technology. For the purpose, six participants were recruited to perform a simulated excavator operation experiment to obtain relevant data. First, a Toeplitz Inverse Covariance-Based Clustering (TICC) method was used to determine the number of levels of mental fatigue using relevant subjective and objective data collected during the experiments. The results revealed the number of mental fatigue levels to be 3 using TICC-based method. Second, four eye movement feature-sets suitable for different construction scenarios were extracted and supervised learning algorithms were used to classify multi-level mental fatigue of the operator. The classification performance analysis of the supervised learning algorithms showed Support Vector Machine (SVM) was the most suitable algorithm to classify mental fatigue in the face of various construction scenarios and subject bias (accuracy between 79.5% and 85.0%). Overall, this study demonstrates the feasibility of applying wearable eye-tracking technology to identify and classify the mental fatigue of construction equipment operators.
引用
收藏
页数:15
相关论文
共 50 条
[41]   Leveraging Eye-Tracking Technology to Understand How Young Children Solve a Mental Rotation Task [J].
Rodriguez, Karinna A. ;
Ralph, Yvonne K. ;
de la Rosa, Isabela M. ;
Corro, Oriana P. Pinto ;
Ochoa, Claudia D. Rey ;
Pruden, Shannon M. .
INFANT AND CHILD DEVELOPMENT, 2025, 34 (03)
[42]   A qualitative analysis on mutual engagement in CSCL scenarios using eye-tracking technology [J].
Lingnau, Andreas ;
Harrer, Andreas .
15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT 2015), 2015, :195-199
[43]   Using Eye-tracking Technology and Google Street View to Understand Cyclists' Perceptions [J].
Brazil, William ;
O'Dowd, Anthony ;
Caulfield, Brian .
2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
[44]   Optimization of Underground Cavern Sign Group Layout Using Eye-Tracking Technology [J].
Zeng, Qin ;
Chen, Yun ;
Zheng, Xiazhong ;
He, Shiyu ;
Li, Donghui ;
Nie, Benwu .
SUSTAINABILITY, 2023, 15 (16)
[45]   Measuring the Impacts of Safety Knowledge on Construction Workers' Attentional Allocation and Hazard Detection Using Remote Eye-Tracking Technology [J].
Hasanzadeh, Sogand ;
Esmaeili, Behzad ;
Dodd, Michael D. .
JOURNAL OF MANAGEMENT IN ENGINEERING, 2017, 33 (05)
[46]   A review of using eye-tracking technology in exploring learning from 2000 to 2012 [J].
Lai, Meng-Lung ;
Tsai, Meng-Jung ;
Yang, Fang-Ying ;
Hsu, Chung-Yuan ;
Liu, Tzu-Chien ;
Lee, Silvia Wen-Yu ;
Lee, Min-Hsien ;
Chiou, Guo-Li ;
Liang, Jyh-Chong ;
Tsai, Chin-Chung .
EDUCATIONAL RESEARCH REVIEW, 2013, 10 :90-115
[47]   Evaluating User Reaction to User Interface Element Using Eye-Tracking Technology [J].
Radecky, Michal ;
Smutny, Pavel .
2014 15TH INTERNATIONAL CARPATHIAN CONTROL CONFERENCE (ICCC), 2014, :475-480
[48]   A Pilot Project Using Eye-Tracking Technology to Design a Standardised Anaesthesia Workspace [J].
Hanhan, Jaber ;
King, Roderick ;
Harrison, T. Kyle ;
Kou, Alex ;
Howard, Steven K. ;
Borg, Lindsay K. ;
Shum, Cynthia ;
Udani, Ankeet D. ;
Mariano, Edward R. .
TURKISH JOURNAL OF ANAESTHESIOLOGY AND REANIMATION, 2018, 46 (06) :411-415
[49]   Shifts in Attention During Mental Fatigue: Evidence From Subjective, Behavioral, Physiological, and Eye-Tracking Data [J].
Hopstaken, Jesper F. ;
van der Linden, Dimitri ;
Bakker, Arnold B. ;
Kompier, Michiel A. J. ;
Leung, Yik Kiu .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2016, 42 (06) :878-889
[50]   Smart cushion-based non-invasive mental fatigue assessment of construction equipment operators: A feasible study [J].
Wang, Lei ;
Li, Heng ;
Yao, Yizhi ;
Han, Dongliang ;
Yu, Changyuan ;
Lyu, Weimin ;
Wu, Haitao .
ADVANCED ENGINEERING INFORMATICS, 2023, 58