A multi-agent reinforcement learning model for maintenance optimization of interdependent highway pavement networks

被引:8
作者
Yao, L. [1 ]
Leng, Z. [1 ]
Jiang, J. [2 ]
Ni, F. [2 ]
机构
[1] Hong Kong Polytech Univ, Dept Civil & Environm Engn, Kowloon, 181Chatham Rd South, Hong Kong, Peoples R China
[2] Southeast Univ, Sch Transportat, Dept Highway & Railway Engn, Nanjing, Jiangsu, Peoples R China
关键词
JOINT OPTIMIZATION; MULTIOBJECTIVE OPTIMIZATION; OPTIMAL POLICIES; REHABILITATION; MANAGEMENT; COST; PERFORMANCE; SYSTEM; HETEROGENEITY;
D O I
10.1111/mice.13234
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Pavement segments are functionally interdependent under traffic equilibrium, leading to interdependent maintenance and rehabilitation (M&R) decisions for different segments, but it has not received significant attention in the pavement management community yet. This study developed a maintenance optimization model for interdependent pavement networks based on the simultaneous network optimization (SNO) framework and a multi-agent reinforcement learning algorithm. The established model was demonstrated on a highway pavement network in the real-world, compared to a previously built two-stage bottom-up (TSBU) model. The results showed that, compared to TSBU, SNO produced a 3.0% reduction in total costs and an average pavement performance improvement of up to 17.5%. It prefers concentrated M&R schedules and tends to take more frequent preventive maintenance to reduce costly rehabilitation. The results of this research are anticipated to provide practitioners with quantitative estimates of the possible impact of ignoring segment interdependencies in M&R planning.
引用
收藏
页码:2951 / 2970
页数:20
相关论文
共 62 条
[51]  
Wang F, 2003, TRANSPORT RES REC, P21
[52]  
Wardrop JG., 1952, P I CIVIL ENG, V1, P325, DOI [10.1680/ipeds.1952.11259, DOI 10.1680/IPEDS.1952.11259, DOI 10.1680/IPEDS.1952.11362]
[53]   Large-Scale Maintenance and Rehabilitation Optimization for Multi-Lane Highway Asphalt Pavement: A Reinforcement Learning Approach [J].
Yao, Linyi ;
Leng, Zhen ;
Jiang, Jiwang ;
Ni, Fujian .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :22094-22105
[54]   Modelling of pavement performance evolution considering uncertainty and interpretability: a machine learning based framework [J].
Yao, Linyi ;
Leng, Zhen ;
Jiang, Jiwang ;
Ni, Fujian .
INTERNATIONAL JOURNAL OF PAVEMENT ENGINEERING, 2022, 23 (14) :5211-5226
[55]   Deep reinforcement learning for long-term pavement maintenance planning [J].
Yao, Linyi ;
Dong, Qiao ;
Jiang, Jiwang ;
Ni, Fujian .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (11) :1230-1245
[56]   Effectiveness and Cost-Effectiveness Evaluation of Pavement Treatments Using Life-Cycle Cost Analysis [J].
Yao, Linyi ;
Dong, Qiao ;
Ni, Fujian ;
Jiang, Jiwang ;
Lu, Xianrong ;
Du, Yingguang .
JOURNAL OF TRANSPORTATION ENGINEERING PART B-PAVEMENTS, 2019, 145 (02)
[57]   Algorithms for bottom-up maintenance optimisation for heterogeneous infrastructure systems [J].
Yeo, Hwasoo ;
Yoon, Yoonjin ;
Madanat, Samer .
STRUCTURE AND INFRASTRUCTURE ENGINEERING, 2013, 9 (04) :317-328
[58]  
Yeo H, 2010, SUSTAINABLE AND RESILIENT CRITICAL INFRASTRUCTURE SYSTEMS: SIMULATION, MODELING, AND INTELLIGENT ENGINEERING, P185, DOI 10.1007/978-3-642-11405-2_7
[59]   Estimating investment requirement for maintaining and improving highway systems [J].
Yin, Yafeng ;
Lawphongpanich, Siriphong ;
Lou, Yingyan .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2008, 16 (02) :199-211
[60]   Multi-objective optimization for asphalt pavement maintenance plans at project level: Integrating performance, cost and environment [J].
Yu, Bin ;
Gu, Xingyu ;
Ni, Fujian ;
Guo, Rui .
TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2015, 41 :64-74