Conceptual closed-loop design of automotive cooling systems leveraging Reinforcement Learning

被引:0
作者
Vanhuyse, Johan [1 ]
Bertheaume, Clement [1 ]
Gumussoy, Suat [2 ]
Nicolai, Mike [1 ]
机构
[1] Siemens Ind Software, Interleuvenlaan 68, B-3001 Heverlee, Belgium
[2] Siemens Technol, 755 Coll Rd E, Princeton, NJ 08540 USA
来源
FORSCHUNG IM INGENIEURWESEN-ENGINEERING RESEARCH | 2025年 / 89卷 / 01期
关键词
Reinforcement learning; Thermal systems; Automotive; Generative engineering;
D O I
10.1007/s10010-025-00814-1
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The transition from conventional to battery electric vehicles has significantly altered cooling system requirements. Previously, the primary component to cool was the combustion engine, whose waste heat could also be used to heat the passenger compartment. In battery electric vehicles, the electric motor, inverter, and battery each operate optimally within different temperature ranges, with battery aging particularly affected by non-optimal temperatures. Consequently, the design of cooling systems for electric vehicles is a topic of high interest, requiring the comparison of various concepts to identify the best solution. Since the behaviour and performance of cooling system concepts largely depend on the control strategy employed, it is essential to consider this aspect for proper evaluation of their closed-loop performance. Reinforcement Learning (RL) offers a promising approach to rapidly design control strategies for thermal systems, as it learns these strategies based on a high-level objective function. Traditionally, training an RL controller involves considerable manual effort, such as hyperparameter tuning. This paper investigates whether RL can be applied to a cooling system to evaluate its optimal closed-loop performance with minimal manual tuning effort.
引用
收藏
页数:11
相关论文
共 50 条
[21]   Autonomous closed-loop guidance using reinforcement learning in a low-thrust, multi-body dynamical environment [J].
LaFarge, Nicholas B. ;
Miller, Daniel ;
Howell, Kathleen C. ;
Linares, Richard .
ACTA ASTRONAUTICA, 2021, 186 :1-23
[22]   Closed-Loop Soft Robot Control Frameworks with Coordinated Policies Based on Reinforcement Learning and Proprioceptive Self-Sensing [J].
Ju, Hunpyo ;
Cha, Baekdong ;
Rus, Daniela ;
Lee, Jongho .
ADVANCED FUNCTIONAL MATERIALS, 2023, 33 (51)
[23]   A Closed-Loop Toolchain for Neural Network Simulations of Learning Autonomous Agents [J].
Jordan, Jakob ;
Weidel, Philipp ;
Morrison, Abigail .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2019, 13
[24]   Isotropic-sequence-order learning in a closed-loop behavioural system [J].
Porr, B ;
Wörgötter, F .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2003, 361 (1811) :2225-2244
[25]   Model-free Reinforcement Learning with a Non-linear Reconstructor for closed-loop Adaptive Optics control with a pyramid wavefront sensor [J].
Pou, B. ;
Smith, J. ;
Quinones, E. ;
Martin, M. ;
Gratadour, D. .
ADAPTIVE OPTICS SYSTEMS VIII, 2022, 12185
[26]   Deep reinforcement learning enables conceptual design of processes for mixtures without [J].
Goettl, Quirin ;
Pirnay, Jonathan ;
Burger, Jakob ;
Grimm, Dominik G. .
COMPUTERS & CHEMICAL ENGINEERING, 2025, 194
[27]   Actor Based Simulation for Closed Loop Control of Supply Chain using Reinforcement Learning [J].
Barat, Souvik ;
Khadilkar, Harshad ;
Meisheri, Hardik ;
Kulkarni, Vinay ;
Baniwal, Vinita .
AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, :1802-1804
[28]   Novel Reinforcement Learning Algorithm for Suppressing Synchronization in Closed Loop Deep Brain Stimulators [J].
Agarwal, Harsh ;
Rathore, Heena .
2023 11TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, NER, 2023,
[29]   Leveraging Deep Reinforcement Learning for Metacognitive Interventions Across Intelligent Tutoring Systems [J].
Abdelshiheed, Mark ;
Hostetter, John Wesley ;
Barnes, Tiffany ;
Chi, Min .
ARTIFICIAL INTELLIGENCE IN EDUCATION, AIED 2023, 2023, 13916 :291-303
[30]   Joint Adaptive OFDM and Reinforcement Learning Design for Autonomous Vehicles: Leveraging Age of Updates [J].
Delamou, Mamady ;
Naeem, Ahmed ;
Arslan, Huseyin ;
Amhoud, El Mehdi .
IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2025, 6 :455-470