Dynamic Optimization of Vehicle Production Planning in Transportation Networks Using Federated Reinforcement Learning

被引:0
作者
Chen, Jinhua [1 ]
Zhu, Xiaogang [2 ,3 ]
Chakraborty, Chinmay [4 ]
Guduri, Manisha [5 ]
Alharbi, Abdullah [6 ]
Tolba, Amr [6 ]
Yu, Keping [1 ]
机构
[1] Hosei Univ, Grad Sch Sci & Engn, Tokyo 1848584, Japan
[2] Nanchang Univ, Sch Publ Policy & Adm, Nanchang 330031, Jiangxi, Peoples R China
[3] Jiangxi Inst Ind Technol Internet Things, Yingtan 335000, Jiangxi, Peoples R China
[4] Birla Inst Technol, Mesra 800014, Bihar, India
[5] Univ Louisiana Lafayette, Sch Comp & Informat, Lafayette, LA 70504 USA
[6] King Saud Univ, Community Coll, Comp Sci Dept, Riyadh 11437, Saudi Arabia
关键词
Production; Production planning; Job shop scheduling; Vehicle dynamics; Planning; Transportation; Dynamic scheduling; Transformers; Optimization; Conferences; Dynamic optimizing; transportation networks; reinforcement learning; federated learning; intelligent large-scale manufacturing; smart vehicles;
D O I
10.1109/TITS.2024.3522523
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Modern transportation networks, with their complexity and dynamic nature, have a substantial demand for intelligent vehicles. Developing effective production strategies for smart vehicles is essential to reducing both production costs and energy consumption. Traditional vehicle production planning has largely depended on heuristic algorithms and solvers, which lack scalability and are susceptible to local optima. Furthermore, existing solutions do not concurrently address both dynamic and regular vehicle production planning. To overcome these limitations, this paper proposes an effective optimizing method for large-scale smart manufacturing within intelligent transportation networks using Federated Reinforcement Learning. In our proposal, the Gated Recurrent Unit and Asynchronous Advantage Actor Critic (A3C) reinforcement algorithms are employed to develop a Dynamic Optimizing Planning Module(DOPM), which can output an excellent solution of 1000 vehicles within 5 seconds. A High-Quality Processing Module(HQPM) is constructed by the Transformer with A3C, significantly enhancing the production plan's quality. Finally, the proposed methods will integrate with Federated Learning (FL) to establish a scalable, privacy-preserving intelligent manufacturing scheduling framework for transportation networks. Experimental results demonstrate that our work significantly outperforms traditional solutions, achieving over a 93% improvement in solving speed and reducing constraint violations by more than 95%.
引用
收藏
页数:13
相关论文
共 35 条
  • [1] Bagdasaryan E., 2019, ADV NEURAL INFORM PR
  • [2] Bonetta G., 2023, INT C LEARN INT OPT, P475
  • [3] A Deep Reinforcement Learning Framework Based on an Attention Mechanism and Disjunctive Graph Embedding for the Job-Shop Scheduling Problem
    Chen, Ruiqi
    Li, Wenxin
    Yang, Hongbing
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1322 - 1331
  • [4] Homomorphic Encryption for Arithmetic of Approximate Numbers
    Cheon, Jung Hee
    Kim, Andrey
    Kim, Miran
    Song, Yongsoo
    [J]. ADVANCES IN CRYPTOLOGY - ASIACRYPT 2017, PT I, 2017, 10624 : 409 - 437
  • [5] A fast and elitist multiobjective genetic algorithm: NSGA-II
    Deb, K
    Pratap, A
    Agarwal, S
    Meyarivan, T
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) : 182 - 197
  • [6] Federated learning-based collaborative manufacturing for complex parts
    Deng, Tianchi
    Li, Yingguang
    Liu, Xu
    Wang, Lihui
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (07) : 3025 - 3038
  • [7] Reinforcement learning applied to production planning and control
    Esteso, Ana
    Peidro, David
    Mula, Josefa
    Diaz-Madronero, Manuel
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2023, 61 (16) : 5772 - 5789
  • [8] Gated-Attention Model with Reinforcement Learning for Solving Dynamic Job Shop Scheduling Problem
    Gebreyesus, Goytom
    Fellek, Getu
    Farid, Ahmed
    Fujimura, Shigeru
    Yoshie, Osamu
    [J]. IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2023, 18 (06) : 932 - 944
  • [9] Deep reinforcement learning-based full-duplex link scheduling in federated learning-based computing for IoMT
    Guan, Zheng
    Li, Ya
    Yu, Shengqian
    Yang, Zhijun
    [J]. TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2023, 34 (03)
  • [10] Federated Deep Reinforcement Learning for Task Scheduling in Heterogeneous Autonomous Robotic System
    Ho, Tai Manh
    Nguyen, Kim-Khoa
    Cheriet, Mohamed
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (01) : 528 - 540