End-to-end deep learning for reverse driving trajectory of autonomous bulldozer

被引:9
作者
You, Ke [1 ,2 ,3 ]
Ding, Lieyun [2 ,3 ]
Jiang, Yutian [4 ]
Wu, Zhangang [4 ]
Zhou, Cheng [2 ,3 ]
机构
[1] Huazhong Univ Sci & Technol, Inst Artificial Intelligence, Wuhan, Hubei, Peoples R China
[2] Huazhong Univ Sci & Technol, Natl Ctr Technol Innovat Digital Construct, Wuhan, Hubei, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Civil & Hydraul Engn, Wuhan, Hubei, Peoples R China
[4] Shantui Construct Machinery Co Ltd, Jining, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
End-to-end; Deep learning; Autonomous bulldozer; Driving trajectory; Intelligence construction; PERCEPTION;
D O I
10.1016/j.knosys.2022.109402
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A changeable and unstructured construction site presents challenges for the operating requirements of autonomous earthmoving machinery. We implement decision planning based on an end-to-end deep learning method, which fills the gap in the research related to the intelligent construction of autonomous bulldozers. Our proposed method can acquire relevant image features in both spatial attention and channel attention based on modified coordinate attention, and comparative analysis demonstrate advantages compared to traditional convolutional methods. We can obtain the output of turning angle and turning point by fusing multimodal data, including images and construction trajectories, and then calculate the reverse driving trajectory. The interpretability of the network is analyzed through visualization. Combined with the large-scale data of construction process collected from experienced operators, we extracted the data sets required for this research to train the model. Results show that our proposed method has anthropomorphic intelligence, which satisfies the decision -making and control process of experienced operators. It is effective in realizing an autonomous bulldozer in actual intelligence construction. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 66 条
[1]   Assessing on-site construction personnel hazard perception in a Middle Eastern developing country: An interactive graphical approach [J].
Abbas, Mohamad ;
Mneymneh, Bahaa Eddine ;
Khoury, Hiam .
SAFETY SCIENCE, 2018, 103 :183-196
[2]  
Amini A., 2018, 2018 IEEE INT C ROB
[3]  
[Anonymous], 2015, 3 INT C LEARN REPR I
[4]   A deep-learning-based computer vision solution for construction vehicle detection [J].
Arabi, Saeed ;
Haghighat, Arya ;
Sharma, Anuj .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (07) :753-767
[5]   An overview of deep learning methods for multimodal medical data mining [J].
Behrad, Fatemeh ;
Abadeh, Mohammad Saniee .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
[6]  
Bojarski M, 2016, Arxiv, DOI [arXiv:1604.07316, DOI 10.48550/ARXIV.1604.07316]
[7]   Knowledge capitalisation through case bases and knowledge engineering for road safety analysis [J].
Boury-Brisset, AC ;
Tourigny, N .
KNOWLEDGE-BASED SYSTEMS, 2000, 13 (05) :297-305
[8]   Find you if you drive: Inferring home locations for vehicles with surveillance camera data [J].
Chen, Kai ;
Yu, Yanwei ;
Song, Peng ;
Tang, Xianfeng ;
Cao, Lei ;
Tong, Xiangrong .
KNOWLEDGE-BASED SYSTEMS, 2020, 196
[9]   IoT sensor-based BIM system for smart safety barriers of hazardous energy in petrochemical construction [J].
Ding, Lieyun ;
Jiang, Weiguang ;
Zhou, Cheng .
FRONTIERS OF ENGINEERING MANAGEMENT, 2022, 9 (01) :1-15
[10]  
Fukui A., 2016, C EMPIRICAL METHODS