An energy management strategy of deep reinforcement learning based on multi-agent architecture under self-generating conditions

被引:4
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Luan, Zhongkai [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Hybrid electric vehicle; Energy management; Generative adversarial network; Multi-agent architecture; Deep reinforcement learning; CONSUMPTION MINIMIZATION STRATEGY; HYBRID ELECTRIC VEHICLE; POWER MANAGEMENT; OPTIMIZATION; SYSTEM; CYCLE; BUS;
D O I
10.1016/j.energy.2023.128536
中图分类号
O414.1 [热力学];
学科分类号
摘要
To improve the driving efficiency of hybrid power vehicle, an energy management strategy of deep reinforcement learning based on multi-agent architecture under self-generating vehicle driving conditions is proposed. Firstly, the kinematics segments are self-generated based on the Wasserstein generative adversarial network. The generator network G is used to generate kinematics segments. The discriminator network D is used to judge the credibility of the generated kinematics segments with the Wasserstein distance. The speed distribution characteristics of the training conditions and verification conditions established based on the self-generated segments are verified. Afterward, a multi-agent algorithm based on twin delayed deep deterministic policy gradient algorithm for hybrid systems is proposed by introducing centralized training with decentralized execution framework. The engine and a motor are used as two independent agents respectively. Different reward functions are designed based on training objectives to establish a mutually beneficial relationship of cooperation-restraint between the two agents. A driving mode constraint is designed in the environment to improve sample utilization. Finally, the simulation results demonstrate that our method can achieve better performance compared with other existing works.
引用
收藏
页数:13
相关论文
共 42 条
  • [1] A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification
    Chang, Chengcheng
    Zhao, Wanzhong
    Wang, Chunyan
    Song, Yingdong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (02) : 1674 - 1688
  • [2] Driving Cycle Recognition Based Adaptive Equivalent Consumption Minimization Strategy for Hybrid Electric Vehicles
    Chen, Dongdong
    Wang, Tie
    Qiao, Tianyou
    Yang, Tiantian
    Ji, Zhiyong
    [J]. IEEE ACCESS, 2022, 10 : 77732 - 77743
  • [3] Deep reinforcement learning-based multi-objective control of hybrid power system combined with road recognition under time-varying environment
    Chen, Jiaxin
    Shu, Hong
    Tang, Xiaolin
    Liu, Teng
    Wang, Weida
    [J]. ENERGY, 2022, 239
  • [4] Adaptive Equivalent Consumption Minimization Strategy (A-ECMS) for the HEVs With a Near-Optimal Equivalent Factor Considering Driving Conditions
    Choi, Kyunghwan
    Byun, Jihye
    Lee, Sangmin
    Jang, In Gwun
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) : 2538 - 2549
  • [5] Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market
    Fang, Xiaohan
    Zhao, Qiang
    Wang, Jinkuan
    Han, Yinghua
    Li, Yuchun
    [J]. SUSTAINABLE CITIES AND SOCIETY, 2021, 74
  • [6] Predictive Energy Management of Plug-in Hybrid Electric Vehicles by Real-Time Optimization and Data-Driven Calibration
    Guo, Ningyuan
    Zhang, Xudong
    Zou, Yuan
    Du, Guangze
    Wang, Chao
    Guo, Lingxiong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (06) : 5677 - 5691
  • [7] Hsu RC, 2016, JOINT INT CONF SOFT, P460, DOI [10.1109/SCIS-ISIS.2016.0104, 10.1109/SCIS&ISIS.2016.30]
  • [8] Predictive energy management with engine switching control for hybrid electric vehicle via ADMM
    Ju, Fei
    Murgovski, Nikolce
    Zhuang, Weichao
    Hu, Xiaosong
    Song, Ziyou
    Wang, Liangmo
    [J]. ENERGY, 2023, 263
  • [9] Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning
    Li, Jiawen
    Yu, Tao
    Zhang, Xiaoshun
    [J]. APPLIED ENERGY, 2022, 306
  • [10] Energy management for a power-split hybrid electric bus via deep reinforcement learning with terrain information
    Li, Yuecheng
    He, Hongwen
    Khajepour, Amir
    Wang, Hong
    Peng, Jiankun
    [J]. APPLIED ENERGY, 2019, 255