A few-shot learning approach for database-free vision-based monitoring on construction sites

被引:46
作者
Kim, Jinwoo [1 ,3 ]
Chi, Seokho [2 ,3 ]
机构
[1] Univ Michigan, Dept Civil & Environm Engn, Ann Arbor, MI 48109 USA
[2] Seoul Natl Univ, Dept Civil & Environm Engn, Seoul 08826, South Korea
[3] Seoul Natl Univ, Inst Construct & Environm Engn, Seoul 08826, South Korea
关键词
Construction site; Vision-based; Site monitoring; Database-free (DB-free); Few-shot learning; Meta-learning; EARTHMOVING EXCAVATORS; SURVEILLANCE VIDEOS; WORKERS ACTIVITIES; ACTION RECOGNITION; NEURAL-NETWORK; PRODUCTIVITY; INSPECTION; EQUIPMENT; CONTEXT;
D O I
10.1016/j.autcon.2021.103566
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper proposes a few-shot learning approach that can successfully learn and detect new construction objects when only a few training data are given. The proposed approach includes few-shot model design and meta learning processes. To validate the approach, the authors conducted experiments using a popular construction benchmark dataset, AIMDataset. Even if only 20 training images were provided to a new construction object, the few-shot learning could build an object detection model with the mean Average Precision of 73.1% on average, whereas the performance of the existing supervised learning was limited to 36.5%. The results imply that the proposed approach can successfully learn and detect new types of construction objects only with few labeled images given, enabling to reduce the number of training images while maximizing the model performance. It would be then possible to save human efforts required for data labeling and enhance the practicality of vision based construction monitoring systems.
引用
收藏
页数:11
相关论文
共 66 条
[61]   Automatic detection of hardhats worn by construction personnel: A deep learning approach and benchmark dataset [J].
Wu, Jixiu ;
Cai, Nian ;
Chen, Wenjie ;
Wang, Huiheng ;
Wang, Guotian .
AUTOMATION IN CONSTRUCTION, 2019, 106
[62]   Meta R-CNN : Towards General Solver for Instance-level Low-shot Learning [J].
Yan, Xiaopeng ;
Chen, Ziliang ;
Xu, Anni ;
Wang, Xiaoxi ;
Liang, Xiaodan ;
Lin, Liang .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9576-9585
[63]   Construction performance monitoring via still images, time-lapse photos, and video streams: Now, tomorrow, and the future [J].
Yang, Jun ;
Park, Man-Woo ;
Vela, Patricio A. ;
Golparvar-Fard, Mani .
ADVANCED ENGINEERING INFORMATICS, 2015, 29 (02) :211-224
[64]   Vision-Based Tower Crane Tracking for Understanding Construction Activity [J].
Yang, Jun ;
Vela, Patricio ;
Teizer, Jochen ;
Shi, Zhongke .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2014, 28 (01) :103-112
[65]   A theory of transfer learning with applications to active learning [J].
Yang, Liu ;
Hanneke, Steve ;
Carbonell, Jaime .
MACHINE LEARNING, 2013, 90 (02) :161-189
[66]  
Youngjib Ham, 2016, Visualization in Engineering, V4, DOI 10.1186/s40327-015-0029-z