PROLIFIC: Deep Reinforcement Learning for Efficient EV Fleet Scheduling and Charging

被引:4
|
作者
Ma, Junchi [1 ]
Zhang, Yuan [1 ]
Duan, Zongtao [1 ]
Tang, Lei [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710061, Peoples R China
关键词
electric vehicles; charging scheduling; reinforcement learning; ride-hailing services; charging stations; OPERATIONS; ALGORITHM; VEHICLES;
D O I
10.3390/su151813553
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Electric vehicles (EVs) are becoming increasingly popular in ride-hailing services, but their slow charging speed negatively affects service efficiency. To address this challenge, we propose PROLIFIC, a deep reinforcement learning-based approach for efficient EV scheduling and charging in ride-hailing services. The objective of PROLIFIC is to minimize passenger waiting time and charging time cost. PROLIFIC formulates the EV scheduling problem as a Markov decision process and integrates a distributed charging scheduling management model and a centralized order dispatching model. By using a distributed deep Q-network, the agents can share charging and EV supply information to make efficient interactions between charging and dispatch decisions. This approach reduces the curse of dimensionality problem and improves the training efficiency of the neural network. The proposed approach is validated in three typical scenarios with different spatiotemporal distribution characteristics of passenger order, and the results demonstrate that PROLIFIC significantly reduces the passenger waiting time and charging time cost in all three scenarios compared to baseline algorithms.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (03) : 2427 - 2439
  • [2] Reinforcement Learning Based EV Charging Scheduling: A Novel Action Space Representation
    Qian, Kun
    Adam, Rebecca
    Brehm, Robert
    2021 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES - ASIA (ISGT ASIA), 2021,
  • [3] CASA: cost-effective EV charging scheduling based on deep reinforcement learning
    Zhang, Ao
    Liu, Qingzhi
    Liu, Jinwei
    Cheng, Long
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (15): : 8355 - 8370
  • [4] Reinforcement Learning for Real-Time Pricing and Scheduling Control in EV Charging Stations
    Wang, Shuoyao
    Bi, Suzhi
    Zhang, Yingjun Angela
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) : 849 - 859
  • [5] Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid
    Park, Keonwoo
    Moon, Ilkyeong
    APPLIED ENERGY, 2022, 328
  • [6] DCLEVERNET: Deep Combinatorial Learning for Efficient EV Charging Scheduling in Large-scale Networked Facilities
    Alshehhi, Bushra
    Karapetyan, Areg
    Elbassioni, Khaled
    Chau, Sid Chi-Kin
    Khonji, Majid
    PROCEEDINGS OF THE 2023 THE 14TH ACM INTERNATIONAL CONFERENCE ON FUTURE ENERGY SYSTEMS, E-ENERGY 2023, 2023, : 287 - 298
  • [7] Mobility-Aware Charging Scheduling for Shared On-Demand Electric Vehicle Fleet Using Deep Reinforcement Learning
    Liang, Yanchang
    Ding, Zhaohao
    Ding, Tao
    Lee, Wei-Jen
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (02) : 1380 - 1393
  • [8] Reinforcement Learning Based EV Charging Management Systems-A Review
    Abdullah, Heba M.
    Gastli, Adel
    Ben-Brahim, Lazhar
    IEEE ACCESS, 2021, 9 : 41506 - 41531
  • [9] Reinforcement Learning based Scheduling for Cooperative EV-to-EV Dynamic Wireless Charging
    Yan, Li
    Shen, Haiying
    Kang, Liuwang
    Zhao, Juanjuan
    Xu, Chengzhong
    2020 IEEE 17TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2020), 2020, : 401 - 409
  • [10] Reinforcement Learning for EV Fleet Smart Charging with On-Site Renewable Energy Sources
    Li, Handong
    Dai, Xuewu
    Goldrick, Stephen
    Kotter, Richard
    Aslam, Nauman
    Ali, Saleh
    ENERGIES, 2024, 17 (21)