Automatic detection of hardhats worn by construction personnel: A deep learning approach and benchmark dataset

被引:180
作者
Wu, Jixiu [1 ]
Cai, Nian [1 ]
Chen, Wenjie [1 ]
Wang, Huiheng [1 ]
Wang, Guotian [2 ]
机构
[1] Guangdong Univ Technol, Sch Informat Engn, Guangzhou 510006, Guangdong, Peoples R China
[2] Face Intelligent Technol Co Ltd, Guangzhou 510032, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Construction sites safety; Hardhat wearing detection; Computer vision; Convolutional neural network; Reverse progressive attention; TRAUMATIC BRAIN-INJURIES; IDENTIFICATION;
D O I
10.1016/j.autcon.2019.102894
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Hardhats play an essential role in protecting construction individuals from accidents. However, wearing hardhats is not strictly enforced among workers due to all kinds of reasons. To enhance construction sites safety, the majority of existing works monitor the presence and proper use of hardhats through multi-stage data processing, which come with limitations on adaption and generalizability. In this paper, a one-stage system based on convolutional neural network is proposed to automatically monitor whether construction personnel are wearing hardhats and identify the corresponding colors. To facilitate the study, this work constructs a new and publicly available hardhat wearing detection benchmark dataset, which consists of 3174 images covering various on-site conditions. Then, features from different layers with different scales are fused discriminately by the proposed reverse progressive attention to generate a new feature pyramid, which will be fed into the Single Shot Multibox Detector (SSD) to predict the final detection results. The proposed system is trained by an end-to-end scheme. The experimental results demonstrate that the proposed system is effective under all kinds of on-site conditions, which can achieve 83.89% mAP (mean average precision) with the input size 512 x 512.
引用
收藏
页数:7
相关论文
共 35 条
[21]  
Li K, 2017, IEEE ANN INT CONF CY, P617, DOI 10.1109/CYBER.2017.8446080
[22]   Feature Pyramid Networks for Object Detection [J].
Lin, Tsung-Yi ;
Dollar, Piotr ;
Girshick, Ross ;
He, Kaiming ;
Hariharan, Bharath ;
Belongie, Serge .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :936-944
[23]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[24]   Vision-Based Framework for Intelligent Monitoring of Hardhat Wearing on Construction Sites [J].
Mneymneh, Bahaa Eddine ;
Abbas, Mohamad ;
Khoury, Hiam .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2019, 33 (02)
[25]   Evaluation of computer vision techniques for automated hardhat detection in indoor construction safety applications [J].
Mneymneh, Bahaa Eddine ;
Abbas, Mohamad ;
Khoury, Hiam .
FRONTIERS OF ENGINEERING MANAGEMENT, 2018, 5 (02) :227-239
[26]   Continuous localization of construction workers via integration of detection and tracking [J].
Park, Man-Woo ;
Brilakis, Ioannis .
AUTOMATION IN CONSTRUCTION, 2016, 72 :129-142
[27]   Hardhat-Wearing Detection for Enhancing On-Site Safety of Construction Workers [J].
Park, Man-Woo ;
Elsafty, Nehad ;
Zhu, Zhenhua .
JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2015, 141 (09)
[28]   Construction worker detection in video frames for initializing vision trackers [J].
Park, Man-Woo ;
Brilakis, Ioannis .
AUTOMATION IN CONSTRUCTION, 2012, 28 :15-25
[29]  
Redmon J, 2018, Arxiv, DOI arXiv:1804.02767
[30]  
Rubaiyat AM, 2016, 2016 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE WORKSHOPS (WIW 2016), P135, DOI [10.1109/WIW.2016.045, 10.1109/WIW.2016.10]