A multi-agent reinforcement learning model for maintenance optimization of interdependent highway pavement networks

被引:8
作者
Yao, L. [1 ]
Leng, Z. [1 ]
Jiang, J. [2 ]
Ni, F. [2 ]
机构
[1] Hong Kong Polytech Univ, Dept Civil & Environm Engn, Kowloon, 181Chatham Rd South, Hong Kong, Peoples R China
[2] Southeast Univ, Sch Transportat, Dept Highway & Railway Engn, Nanjing, Jiangsu, Peoples R China
关键词
JOINT OPTIMIZATION; MULTIOBJECTIVE OPTIMIZATION; OPTIMAL POLICIES; REHABILITATION; MANAGEMENT; COST; PERFORMANCE; SYSTEM; HETEROGENEITY;
D O I
10.1111/mice.13234
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Pavement segments are functionally interdependent under traffic equilibrium, leading to interdependent maintenance and rehabilitation (M&R) decisions for different segments, but it has not received significant attention in the pavement management community yet. This study developed a maintenance optimization model for interdependent pavement networks based on the simultaneous network optimization (SNO) framework and a multi-agent reinforcement learning algorithm. The established model was demonstrated on a highway pavement network in the real-world, compared to a previously built two-stage bottom-up (TSBU) model. The results showed that, compared to TSBU, SNO produced a 3.0% reduction in total costs and an average pavement performance improvement of up to 17.5%. It prefers concentrated M&R schedules and tends to take more frequent preventive maintenance to reduce costly rehabilitation. The results of this research are anticipated to provide practitioners with quantitative estimates of the possible impact of ignoring segment interdependencies in M&R planning.
引用
收藏
页码:2951 / 2970
页数:20
相关论文
共 62 条
[1]   Scheduling cost optimization and neural dynamics model for construction [J].
Adeli, H ;
Karim, A .
JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT-ASCE, 1997, 123 (04) :450-458
[2]   Mesoscopic-wavelet freeway work zone flow and congestion feature extraction model [J].
Adeli, H ;
Ghosh-Dastidar, S .
JOURNAL OF TRANSPORTATION ENGINEERING, 2004, 130 (01) :94-103
[3]  
Adeli H., 2009, INTELLIGENT INFRASTR
[4]   Pavement maintenance and rehabilitation budget allocation considering multiple objectives and multiple stakeholders [J].
Al Amin, Md ;
Pan, Shidong ;
Zhang, Zhanmin .
INTERNATIONAL JOURNAL OF PAVEMENT ENGINEERING, 2023, 24 (02)
[5]  
[Anonymous], 2017, ARXIV170605296
[6]  
[Anonymous], 1964, US DEP COMMERCE
[7]   Multiagent Reinforcement Learning for Project-Level Intervention Planning under Multiple Uncertainties [J].
Asghari, Vahid ;
Biglari, Ava Jahan ;
Hsu, Shu-Chien .
JOURNAL OF MANAGEMENT IN ENGINEERING, 2023, 39 (02)
[8]   Multi-objective optimization for maintaining low-noise pavement network system in Hong Kong [J].
Cao, Ruijun ;
Leng, Zhen ;
Yu, Jiangmiao ;
Hsu, Shu-Chien .
TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2020, 88
[9]  
Chatti K., 2012, Estimating the effects of pavement condition on vehicle operating costs, V720
[10]   A Collaborative Communication-Qmix Approach for Large-scale Networked Traffic Signal Control [J].
Chen, Xiaoyu ;
Xiong, Gang ;
Lv, Yisheng ;
Chen, Yuanyuan ;
Song, Bing ;
Wang, Fei-Yue .
2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, :3450-3455