A few-shot learning approach for database-free vision-based monitoring on construction sites

被引:46
作者
Kim, Jinwoo [1 ,3 ]
Chi, Seokho [2 ,3 ]
机构
[1] Univ Michigan, Dept Civil & Environm Engn, Ann Arbor, MI 48109 USA
[2] Seoul Natl Univ, Dept Civil & Environm Engn, Seoul 08826, South Korea
[3] Seoul Natl Univ, Inst Construct & Environm Engn, Seoul 08826, South Korea
关键词
Construction site; Vision-based; Site monitoring; Database-free (DB-free); Few-shot learning; Meta-learning; EARTHMOVING EXCAVATORS; SURVEILLANCE VIDEOS; WORKERS ACTIVITIES; ACTION RECOGNITION; NEURAL-NETWORK; PRODUCTIVITY; INSPECTION; EQUIPMENT; CONTEXT;
D O I
10.1016/j.autcon.2021.103566
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper proposes a few-shot learning approach that can successfully learn and detect new construction objects when only a few training data are given. The proposed approach includes few-shot model design and meta learning processes. To validate the approach, the authors conducted experiments using a popular construction benchmark dataset, AIMDataset. Even if only 20 training images were provided to a new construction object, the few-shot learning could build an object detection model with the mean Average Precision of 73.1% on average, whereas the performance of the existing supervised learning was limited to 36.5%. The results imply that the proposed approach can successfully learn and detect new types of construction objects only with few labeled images given, enabling to reduce the number of training images while maximizing the model performance. It would be then possible to save human efforts required for data labeling and enhance the practicality of vision based construction monitoring systems.
引用
收藏
页数:11
相关论文
共 66 条
[51]   Vision-Based Construction Worker Activity Analysis Informed by Body Posture [J].
Roberts, Dominic ;
Torres Calderon, Wilfredo ;
Tang, Shuai ;
Golparvar-Fard, Mani .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2020, 34 (04)
[52]   End-to-end vision-based detection, tracking and activity analysis of earthmoving equipment filmed at ground level [J].
Roberts, Dominic ;
Golparvar-Fare, Mani .
AUTOMATION IN CONSTRUCTION, 2019, 105
[53]   ImageNet Large Scale Visual Recognition Challenge [J].
Russakovsky, Olga ;
Deng, Jia ;
Su, Hao ;
Krause, Jonathan ;
Satheesh, Sanjeev ;
Ma, Sean ;
Huang, Zhiheng ;
Karpathy, Andrej ;
Khosla, Aditya ;
Bernstein, Michael ;
Berg, Alexander C. ;
Fei-Fei, Li .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) :211-252
[54]   Computer vision techniques for construction safety and health monitoring [J].
Seo, JoonOh ;
Han, SangUk ;
Lee, SangHyun ;
Kim, Hyoungkwan .
ADVANCED ENGINEERING INFORMATICS, 2015, 29 (02) :239-251
[55]   Automated annotation for visual recognition of construction resources using synthetic images [J].
Soltani, Mohammad Mostafa ;
Zhu, Zhenhua ;
Hammad, Amin .
AUTOMATION IN CONSTRUCTION, 2016, 62 :14-23
[56]   Real-Time Vision-Based Warning System for Prevention of Collisions between Workers and Heavy Equipment [J].
Son, Hyojoo ;
Seong, Hyeonwoo ;
Choi, Hyunchul ;
Kim, Changwan .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2019, 33 (05)
[57]   Detection of construction workers under varying poses and changing background in image sequences via very deep residual networks [J].
Son, Hyojoo ;
Choi, Hyunchul ;
Seong, Hyeonwoo ;
Kim, Changwan .
AUTOMATION IN CONSTRUCTION, 2019, 99 :27-38
[58]  
van der Maaten L, 2008, J MACH LEARN RES, V9, P2579
[59]   Crowdsourced reliable labeling of safety-rule violations on images of complex construction scenes for advanced vision-based workplace safety [J].
Wang, Yanyu ;
Liao, Pin-Chao ;
Zhang, Cheng ;
Ren, Yi ;
Sun, Xinlu ;
Tang, Pingbo .
ADVANCED ENGINEERING INFORMATICS, 2019, 42
[60]   Meta-Learning to Detect Rare Objects [J].
Wang, Yu-Xiong ;
Ramanan, Deva ;
Hebert, Martial .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9924-9933