Lenovo Schedules Laptop Manufacturing Using Deep Reinforcement Learning

被引:7
|
作者
Liang, Yi [1 ]
Sun, Zan [1 ]
Song, Tianheng [1 ]
Chou, Qiang [1 ]
Fan, Wei [1 ]
Fan, Jianping [1 ]
Rui, Yong [1 ]
Zhou, Qiping [2 ]
Bai, Jessie [2 ]
Yang, Chun [2 ]
Bai, Peng [2 ]
机构
[1] Lenovo Res, AI Lab, Beijing 100193, Peoples R China
[2] LCFC, Lenovo, Hefei 230601, Peoples R China
来源
INFORMS JOURNAL ON APPLIED ANALYTICS | 2022年 / 52卷 / 01期
关键词
production scheduling; deep reinforcement learning; multiobjective optimization; combinatorial optimization; Edelman Award; ALGORITHM;
D O I
10.1287/inte.2021.1109
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Lenovo Research teamed with members of the factory operations group at Lenovo's largest laptop manufacturing facility, LCFC, to replace a manual production scheduling system with a decision-making platform built on a deep reinforcement learning architecture. The system schedules production orders at all LCFC's 43 assembly manufacturing lines, balancing the relative priorities of production volume, changeover cost, and order fulfillment. The multiobjective optimization scheduling problem is solved using a deep reinforcement learning model. The approach combines high computing effi- ciency with a novel masking mechanism that enforces operational constraints to ensure that the machine-learning model does not waste time exploring infeasible solutions. The use of the new model transformed the production management process enabling a 20% reduction in the backlog of production orders and a 23% improvement in the fulfillment rate. It also reduced the entire scheduling process from six hours to 30 minutes while it retained multiobjective flexibility to allow LCFC to adjust quickly to changing objectives. The work led to increased revenue of US $1.91 billion in 2019 and US $2.69 billion in 2020 for LCFC. The methodology can be applied to other scenarios in the industry.
引用
收藏
页码:56 / 68
页数:14
相关论文
共 50 条
  • [31] Multiobjective Combinatorial Optimization Using a Single Deep Reinforcement Learning Model
    Wang, Zhenkun
    Yao, Shunyu
    Li, Genghui
    Zhang, Qingfu
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (03) : 1984 - 1996
  • [32] Influence Maximization in Complex Networks by Using Evolutionary Deep Reinforcement Learning
    Ma, Lijia
    Shao, Zengyang
    Li, Xiaocong
    Lin, Qiuzhen
    Li, Jianqiang
    Leung, Victor C. M.
    Nandi, Asoke K.
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (04): : 995 - 1009
  • [33] Developments in Image Processing Using Deep Learning and Reinforcement Learning
    Valente, Jorge
    Antonio, Joao
    Mora, Carlos
    Jardim, Sandra
    JOURNAL OF IMAGING, 2023, 9 (10)
  • [34] Equipment Health Indicator Learning Using Deep Reinforcement Learning
    Zhang, Chi
    Gupta, Chetan
    Farahat, Ahmed
    Ristovski, Kosta
    Ghosh, Dipanjan
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT III, 2019, 11053 : 488 - 504
  • [35] Deep reinforcement learning applied to the k-server problem
    Sousa Lins, Ramon Augusto
    Neto Doria, Adriao Duarte
    de Melo, Jorge Dantas
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 135 : 212 - 218
  • [36] A Deep-Reinforcement-Learning-Based Optimization Approach for Real-Time Scheduling in Cloud Manufacturing
    Zhu, Huayu
    Li, Mengrong
    Tang, Yong
    Sun, Yanfei
    IEEE ACCESS, 2020, 8 : 9987 - 9997
  • [37] An improved deep reinforcement learning-based scheduling approach for dynamic task scheduling in cloud manufacturing
    Wang, Xiaohan
    Zhang, Lin
    Liu, Yongkui
    Laili, Yuanjun
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2024, 62 (11) : 4014 - 4030
  • [38] Deep Reinforcement Learning: From Q-Learning to Deep Q-Learning
    Tan, Fuxiao
    Yan, Pengfei
    Guan, Xinping
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT IV, 2017, 10637 : 475 - 483
  • [39] Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
    Frikha, Mohamed Said
    Gammar, Sonia Mettali
    Lahmadi, Abdelkader
    Andrey, Laurent
    COMPUTER COMMUNICATIONS, 2021, 178 : 98 - 113
  • [40] A Deep-Reinforcement-Learning-Based Digital Twin for Manufacturing Process Optimization
    Khdoudi, Abdelmoula
    Masrour, Tawfik
    El Hassani, Ibtissam
    El Mazgualdi, Choumicha
    SYSTEMS, 2024, 12 (02):