Hybrid Prompt-Driven Large Language Model for Robust State-of-Charge Estimation of Multitype Li-ion Batteries

被引:2
作者
Bian, Chong [1 ]
Han, Xue [1 ]
Duan, Zhiyu [2 ]
Deng, Chao [1 ]
Yang, Shunkun [2 ]
Feng, Junlan [1 ]
机构
[1] China Mobile Res Inst, Artificial Intelligence & Intelligent Operat Ctr, Beijing 100053, Peoples R China
[2] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
关键词
Estimation; Task analysis; State of charge; Temperature measurement; Vectors; Robustness; Transformers; Hybrid prompt learning; large language model (LLM); multitype Li-ion batteries (LIBs); state-of-charge (SOC) estimation; NEURAL-NETWORKS;
D O I
10.1109/TTE.2024.3391938
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
State-of-charge (SOC) estimation is critical for reliable operation of Li-ion batteries (LIBs). However, the distinct electrochemical characteristics coupled with harsh low-temperature environments make a single estimator struggle to robustly estimate the volatile SOC of multitype LIBs. To address these issues, this article proposes a hard-soft hybrid prompt learning method to unleash the potential of a pretrained large language model (LLM) for SOC estimation. A textual encoder is introduced to convert LIB measurements into hard text prompts for language modeling, naturally eliciting the pretrained LLM to capture the intrarelations of measured values over time and their interrelations with contextual semantics for accurate estimates. A side adapter network is constructed to reparameterize model adaptation towards different LIB tasks into optimizations within a low-dimensional subspace, strengthening the estimation generalization of the pretrained LLM in a parameter-efficient manner. A knowledge infusion mechanism is designed to encapsulate task-specific information as soft prompt vectors for model integration along forward propagation, dynamically conditioning the hidden states inside the pretrained LLM to enhance the estimation robustness against SOC volatilities. Extensive experiments verify that the hybrid prompt-driven LLM can simultaneously perform estimations for multitype LIBs under diverse operations and sub-zero temperatures with superior accuracy, generalization, and robustness.
引用
收藏
页码:426 / 437
页数:12
相关论文
共 44 条
[1]  
Akioyamen P., 2018, Medium
[2]   Estimating State of Charge for xEV Batteries Using 1D Convolutional Neural Networks and Transfer Learning [J].
Bhattacharjee, Arnab ;
Verma, Ashu ;
Mishra, Sukumar ;
Saha, Tapan K. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (04) :3123-3135
[3]   Robust state-of-charge estimation of Li-ion batteries based on multichannel convolutional and bidirectional recurrent neural networks [J].
Bian, Chong ;
Yang, Shunkun ;
Liu, Jie ;
Zio, Enrico .
APPLIED SOFT COMPUTING, 2022, 116
[4]   Cross-Domain State-of-Charge Estimation of Li-Ion Batteries Based on Deep Transfer Neural Network With Multiscale Distribution Adaptation [J].
Bian, Chong ;
Yang, Shunkun ;
Miao, Qiang .
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (03) :1260-1270
[5]   Stacked bidirectional long short-term memory networks for state-of-charge estimation of lithium-ion batteries [J].
Bian, Chong ;
He, Huoliang ;
Yang, Shunkun .
ENERGY, 2020, 191
[6]   State-of-charge sequence estimation of lithium-ion battery based on bidirectional long short-term memory encoder-decoder architecture [J].
Bian, Chong ;
He, Huoliang ;
Yang, Shunkun ;
Huang, Tingting .
JOURNAL OF POWER SOURCES, 2020, 449
[7]   State-of-charge estimation of Li-ion batteries using deep neural networks: A machine learning approach [J].
Chemali, Ephrem ;
Kollmeyer, Phillip J. ;
Preindl, Matthias ;
Emadi, Ali .
JOURNAL OF POWER SOURCES, 2018, 400 :242-255
[8]   Long Short-Term Memory Networks for Accurate State-of-Charge Estimation of Li-ion Batteries [J].
Chemali, Ephrem ;
Kollmeyer, Phillip J. ;
Preindl, Matthias ;
Ahmed, Ryan ;
Emadi, Ali .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (08) :6730-6739
[9]   Joint Estimation of State of Charge and State of Energy of Lithium-Ion Batteries Based on Optimized Bidirectional Gated Recurrent Neural Network [J].
Chen, Liping ;
Song, Yingjie ;
Lopes, Antonio M. ;
Bao, Xinyuan ;
Zhang, Zhiqiang ;
Lin, Yong .
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (01) :1605-1616
[10]  
Du ZX, 2022, PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), P320