Markov decision process based value chain calculation of water distribution network scheduling

被引:0
作者
Ji, Xuanting [1 ,2 ]
Chen, Minghai [1 ,2 ]
Pu, Zhengheng [1 ,2 ]
Fu, Yanfu [1 ,2 ]
Tao, Tao [1 ,2 ]
Xin, Kunlun [1 ,2 ]
机构
[1] College of Environmental Science and Engineering, Tongji University, 1239 Siping Road, Yangpu District, Shanghai
[2] Smart Water Joint Innovation R&D Center, Tongji University, 1239 Siping Road, Yangpu District, Shanghai
关键词
Markov decision process; Value calculation; Water distribution network scheduling;
D O I
10.1016/j.wen.2023.12.001
中图分类号
学科分类号
摘要
Precise value of scheduling decisions forms the cornerstone of water distribution network (WDN) scheduling optimization, which aims at conserving energy and enhancing network operational efficiency. This article proposes a computational methodology for evaluating the value chain of scheduling decisions in WDN. The scheduling process is modeled as a Markov decision process with immediate reward function, action and state space. Due to the periodicity of water supply and sequential nature of scheduling, the calculation quantifies cumulative value of scheduling decisions by incorporating state transition probability with expected value. The effectiveness and applicability of the proposed evaluation method are demonstrated using scheduling data from a real world WDN. The method provides rational values on scheduling period and strategies, offering practical feedback for scheduling decisions. © 2023
引用
收藏
页码:13 / 25
页数:12
相关论文
共 27 条
  • [1] Bagloee S.A., Asadi M., Patriksson M., Minimization of water pumps’ electricity usage: A hybrid approach of regression models with optimization, Exp. Syst. Appl., 107, pp. 222-242, (2018)
  • [2] Barros Filho E.G., Salvino L.R., Bezerra S.D.T.M., Salvino M.M., Gomes H.P., Intelligent system for control of water distribution networks, Water Sci. Technol.: Water Supply, 18, 4, pp. 1270-1281, (2018)
  • [3] Bellman R., A markovian decision process, J. Math. Mech., pp. 679-684, (1957)
  • [4] Bellman R., Dynamic programming, Science, 153, 3731, pp. 34-37, (1966)
  • [5] Bezerra S., Silva S.A., Gomes H.P., Salvino M.M., Energy savings in pumping systems: Application of a fuzzy system, Ciência & Engenharia, 24, 1, pp. 71-78, (2015)
  • [6] Boccelli D.L., Tryby M.E., Uber J.G., Rossman L.A., Zierolf M.L., Polycarpou M.M., Optimal scheduling of booster disinfection in water distribution systems, J. Water Resour. Plan. Manage., 124, 2, pp. 99-111, (1998)
  • [7] Farmani R., Walters G., Savic D., Evolutionary multi-objective optimization of the design and operation of water distribution network: total cost vs. reliability vs. water quality, Journal of hydroinformatics, 8, 3, pp. 165-179, (2006)
  • [8] Giustolisi O., Simone A., Ridolfi L., Network structure classification and features of water distribution systems, Water Resour. Res., 53, 4, pp. 3407-3423, (2017)
  • [9] Hastings W.K., (1970)
  • [10] Housh M., Salomons E., Optimal dynamic pump triggers for cost saving and robust water distribution system operations, Journal of Water Resources Planning and Management, 145, 2, (2019)