Automated construction scheduling using deep reinforcement learning with valid action sampling

被引:7
作者
Yao, Yuan [1 ]
Tam, Vivian W. Y. [1 ]
Wang, Jun [1 ]
Le, Khoa N. [1 ]
Butera, Anthony [1 ]
机构
[1] Western Sydney Univ, Sch Engn Design & Built Environm, Locked Bag 1797, Penrith, NSW 2751, Australia
基金
澳大利亚研究理事会;
关键词
Construction scheduling; Reinforcement learning; Action masking; Reward shaping; Graph neural network; Off-site construction; PROJECTS;
D O I
10.1016/j.autcon.2024.105622
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The growing demand for buildings and infrastructures requires optimal construction schedules under real-world complexities. This paper presents an automated scheduling optimization method for large construction projects, considering real-world constraints and the need for rescheduling. A Deep Reinforcement Learning (DRL) model with a Valid Action Sampling (VAS) mechanism is proposed to optimize schedules. The method integrates a Graph Convolutional Network (GCN) for feature extraction and includes a reward shaping mechanism to expedite convergence. The proposed method outperforms traditional methods with reduced project duration and runtime in both scheduling and rescheduling cases. This advancement benefits construction managers seeking efficient and flexible project management. The findings inspire future research into broader and more practical construction scheduling solutions utilizing DRL.
引用
收藏
页数:18
相关论文
共 50 条
[1]  
AAMODT A, 1994, AI COMMUN, V7, P39
[2]   Reducing completion time and optimizing resource use of resource-constrained construction operation by means of simulation modeling [J].
Ahmed, Tanvir ;
Hossain, Sayed Mukit ;
Hossain, Md. Aslam .
INTERNATIONAL JOURNAL OF CONSTRUCTION MANAGEMENT, 2021, 21 (04) :404-415
[3]   Construction schedule augmentation with implicit dependency constraints and automated generation of lookahead plan revisions [J].
Amer, Fouad ;
Jung, Yoonhwa ;
Golparvar-Fard, Mani .
AUTOMATION IN CONSTRUCTION, 2023, 152
[4]   Transformer machine learning language model for auto-alignment of long-term and short-term plans in construction [J].
Amer, Fouad ;
Jung, Yoonhwa ;
Golparvar-Fard, Mani .
AUTOMATION IN CONSTRUCTION, 2021, 132
[5]   Automated Methods and Systems for Construction Planning and Scheduling: Critical Review of Three Decades of Research [J].
Amer, Fouad ;
Koh, Hui Yi ;
Golparvar-Fard, Mani .
JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2021, 147 (07)
[6]   Managing engineering systems with large state and action spaces through deep reinforcement learning [J].
Andriotis, C. P. ;
Papakonstantinou, K. G. .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2019, 191
[7]   Reinforcement Learning in Construction Engineering and Management: A Review [J].
Asghari, Vahid ;
Wang, Yanyu ;
Biglari, Ava Jahan ;
Hsu, Shu-Chien ;
Tang, Pingbo .
JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2022, 148 (11)
[8]  
Bai YJ, 2009, LECT NOTES COMPUT SC, V5553, P1146
[9]   Hybrid Genetic Algorithm with Simulated Annealing for Resource-Constrained Project Scheduling [J].
Bettemir, Onder Halis ;
Sonmez, Rifat .
JOURNAL OF MANAGEMENT IN ENGINEERING, 2015, 31 (05)
[10]   Resource levelling in project scheduling with generalized precedence relationships and variable execution intensities [J].
Bianco, Lucio ;
Caramia, Massimiliano ;
Giordani, Stefano .
OR SPECTRUM, 2016, 38 (02) :405-425