Lenovo Schedules Laptop Manufacturing Using Deep Reinforcement Learning

被引:7
|
作者
Liang, Yi [1 ]
Sun, Zan [1 ]
Song, Tianheng [1 ]
Chou, Qiang [1 ]
Fan, Wei [1 ]
Fan, Jianping [1 ]
Rui, Yong [1 ]
Zhou, Qiping [2 ]
Bai, Jessie [2 ]
Yang, Chun [2 ]
Bai, Peng [2 ]
机构
[1] Lenovo Res, AI Lab, Beijing 100193, Peoples R China
[2] LCFC, Lenovo, Hefei 230601, Peoples R China
来源
INFORMS JOURNAL ON APPLIED ANALYTICS | 2022年 / 52卷 / 01期
关键词
production scheduling; deep reinforcement learning; multiobjective optimization; combinatorial optimization; Edelman Award; ALGORITHM;
D O I
10.1287/inte.2021.1109
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Lenovo Research teamed with members of the factory operations group at Lenovo's largest laptop manufacturing facility, LCFC, to replace a manual production scheduling system with a decision-making platform built on a deep reinforcement learning architecture. The system schedules production orders at all LCFC's 43 assembly manufacturing lines, balancing the relative priorities of production volume, changeover cost, and order fulfillment. The multiobjective optimization scheduling problem is solved using a deep reinforcement learning model. The approach combines high computing effi- ciency with a novel masking mechanism that enforces operational constraints to ensure that the machine-learning model does not waste time exploring infeasible solutions. The use of the new model transformed the production management process enabling a 20% reduction in the backlog of production orders and a 23% improvement in the fulfillment rate. It also reduced the entire scheduling process from six hours to 30 minutes while it retained multiobjective flexibility to allow LCFC to adjust quickly to changing objectives. The work led to increased revenue of US $1.91 billion in 2019 and US $2.69 billion in 2020 for LCFC. The methodology can be applied to other scenarios in the industry.
引用
收藏
页码:56 / 68
页数:14
相关论文
共 50 条
  • [1] Dynamic resource matching in manufacturing using deep reinforcement learning
    Panda, Saunak Kumar
    Xiang, Yisha
    Liu, Ruiqi
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2024, 318 (02) : 408 - 423
  • [2] Deep reinforcement learning in smart manufacturing: A review and prospects
    Li, Chengxi
    Zheng, Pai
    Yin, Yue
    Wang, Baicun
    Wang, Lihui
    CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2023, 40 : 75 - 101
  • [3] Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning
    Wang, Libing
    Hu, Xin
    Wang, Yin
    Xu, Sujie
    Ma, Shijun
    Yang, Kexin
    Liu, Zhijun
    Wang, Weidong
    COMPUTER NETWORKS, 2021, 190 (190)
  • [4] Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning
    Liu, Yongkui
    Ping, Yaoyao
    Zhang, Lin
    Wang, Lihui
    Xu, Xun
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 80
  • [5] Task scheduling based on deep reinforcement learning in a cloud manufacturing environment
    Dong, Tingting
    Xue, Fei
    Xiao, Chuangbai
    Li, Juntao
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (11)
  • [6] An efficient cloud manufacturing service composition approach using deep reinforcement learning
    Fazeli, Mohammad Moein
    Farjami, Yaghoub
    Bidgoly, Amir Jalaly
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 195
  • [7] A framework for scheduling in cloud manufacturing with deep reinforcement learning
    Liu, Yongkui
    Zhang, Lin
    Wang, Lihui
    Xiao, Yingying
    Xu, Xun
    Wang, Mei
    2019 IEEE 17TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2019, : 1775 - 1780
  • [8] Using Deep Reinforcement Learning to Decide Test Length
    Zoucha, James
    Himelfarb, Igor
    Tang, Nai-En
    EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2025,
  • [9] Automatic Itinerary Planning Using Triple-Agent Deep Reinforcement Learning
    Chen, Bo-Hao
    Han, Jin
    Chen, Shengxin
    Yin, Jia-Li
    Chen, Zhaojiong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 18864 - 18875
  • [10] Manufacturing Control in Job Shop Environments with Reinforcement Learning
    Samsonov, Vladimir
    Kemmerling, Marco
    Paegert, Maren
    Luetticke, Daniel
    Sauermann, Frederick
    Guetzlaff, Andreas
    Schuh, Gunther
    Meisen, Tobias
    ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2021, : 589 - 597