Lenovo Schedules Laptop Manufacturing Using Deep Reinforcement Learning

被引:7
|
作者
Liang, Yi [1 ]
Sun, Zan [1 ]
Song, Tianheng [1 ]
Chou, Qiang [1 ]
Fan, Wei [1 ]
Fan, Jianping [1 ]
Rui, Yong [1 ]
Zhou, Qiping [2 ]
Bai, Jessie [2 ]
Yang, Chun [2 ]
Bai, Peng [2 ]
机构
[1] Lenovo Res, AI Lab, Beijing 100193, Peoples R China
[2] LCFC, Lenovo, Hefei 230601, Peoples R China
来源
INFORMS JOURNAL ON APPLIED ANALYTICS | 2022年 / 52卷 / 01期
关键词
production scheduling; deep reinforcement learning; multiobjective optimization; combinatorial optimization; Edelman Award; ALGORITHM;
D O I
10.1287/inte.2021.1109
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Lenovo Research teamed with members of the factory operations group at Lenovo's largest laptop manufacturing facility, LCFC, to replace a manual production scheduling system with a decision-making platform built on a deep reinforcement learning architecture. The system schedules production orders at all LCFC's 43 assembly manufacturing lines, balancing the relative priorities of production volume, changeover cost, and order fulfillment. The multiobjective optimization scheduling problem is solved using a deep reinforcement learning model. The approach combines high computing effi- ciency with a novel masking mechanism that enforces operational constraints to ensure that the machine-learning model does not waste time exploring infeasible solutions. The use of the new model transformed the production management process enabling a 20% reduction in the backlog of production orders and a 23% improvement in the fulfillment rate. It also reduced the entire scheduling process from six hours to 30 minutes while it retained multiobjective flexibility to allow LCFC to adjust quickly to changing objectives. The work led to increased revenue of US $1.91 billion in 2019 and US $2.69 billion in 2020 for LCFC. The methodology can be applied to other scenarios in the industry.
引用
收藏
页码:56 / 68
页数:14
相关论文
共 50 条
  • [21] Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learning
    Wang, Xiaohan
    Zhang, Lin
    Liu, Yongkui
    Zhao, Chun
    Wang, Kunyu
    JOURNAL OF MANUFACTURING SYSTEMS, 2022, 65 : 452 - 468
  • [22] Simulation and deep reinforcement learning for adaptive dispatching in semiconductor manufacturing systems
    Ahmed H. Sakr
    Ayman Aboelhassan
    Soumaya Yacout
    Samuel Bassetto
    Journal of Intelligent Manufacturing, 2023, 34 : 1311 - 1324
  • [23] An Index Advisor Using Deep Reinforcement Learning
    Lan, Hai
    Bao, Zhifeng
    Peng, Yuwei
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2105 - 2108
  • [24] Dynamic Positioning using Deep Reinforcement Learning
    Overeng, Simen Sem
    Nguyen, Dong Trong
    Hamre, Geir
    OCEAN ENGINEERING, 2021, 235
  • [25] Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
    Khadivi, Maziyar
    Charter, Todd
    Yaghoubi, Marjan
    Jalayer, Masoud
    Ahang, Maryam
    Shojaeinasab, Ardeshir
    Najjaran, Homayoun
    COMPUTERS & INDUSTRIAL ENGINEERING, 2025, 200
  • [26] Distributed Deep Reinforcement Learning using TensorFlow
    Rao, P. Ajay
    Kumar, Navaneesh B.
    Cadabam, Siddharth
    Praveena, T.
    2017 INTERNATIONAL CONFERENCE ON CURRENT TRENDS IN COMPUTER, ELECTRICAL, ELECTRONICS AND COMMUNICATION (CTCEEC), 2017, : 171 - 174
  • [27] Tetris Bot using Deep Reinforcement Learning
    Park K.-W.
    Kim J.-S.
    Journal of Institute of Control, Robotics and Systems, 2022, 28 (12) : 1155 - 1160
  • [28] A multi-layer and multi-ensemble stock trader using deep learning and deep reinforcement learning
    Carta, Salvatore
    Corriga, Andrea
    Ferreira, Anselmo
    Podda, Alessandro Sebastian
    Recupero, Diego Reforgiato
    APPLIED INTELLIGENCE, 2021, 51 (02) : 889 - 905
  • [29] Downlink Scheduler for Delay Guaranteed Services Using Deep Reinforcement Learning
    Ji, Jiequ
    Ren, Xiangyu
    Cai, Lin
    Zhu, Kun
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) : 3376 - 3390
  • [30] Comparison of algorithms using deep reinforcement learning for optimization of hyperbolic metamaterials
    Hamada, Kenta
    Hsiao, Hui-Hsin
    Kubo, Wakana
    SCIENTIFIC REPORTS, 2024, 14 (01):