Enhancing Digital Twins through Reinforcement Learning

被引:0
|
作者
Cronrath, Constantin [1 ]
Aderiani, Abolfazi R. [2 ]
Lennartson, Bengt [1 ]
机构
[1] Chalmers Univ Technol, Dept Elect Engn, Gothenburg, Sweden
[2] Chalmers Univ Technol, Dept Ind & Mat Sci, Gothenburg, Sweden
来源
2019 IEEE 15TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE) | 2019年
关键词
D O I
10.1109/coase.2019.8842888
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Digital Twins are core enablers of smart and autonomous manufacturing systems. Although they strive to represent their physical counterpart as accurately as possible, slight model or data errors will remain. We present an algorithm to compensate for those residual errors through Reinforcement Learning (RL) and data fed back from the manufacturing system. When learning, the Digital Twin acts as teacher and safety policy to ensure minimal performance. We test the algorithm in a sheet metal assembly context, in which locators of the fixture are optimally adjusted for individual assemblies. Our results show a fast adaption and improved performance of the autonomous system.
引用
收藏
页码:293 / 298
页数:6
相关论文
共 50 条
  • [1] Inference of Simulation Models in Digital Twins by Reinforcement Learning
    David, Istvan
    Galasso, Jessie
    Syriani, Eugene
    24TH ACM/IEEE INTERNATIONAL CONFERENCE ON MODEL-DRIVEN ENGINEERING LANGUAGES AND SYSTEMS COMPANION (MODELS-C 2021), 2021, : 223 - 226
  • [2] Sustainability of Data Center Digital Twins with Reinforcement Learning
    Sarkar, Soumyendu
    Naug, Avisek
    Guillen, Antonio
    Luna, Ricardo
    Gundecha, Vineet
    Babu, Ashwin Ramesh
    Mousavi, Sajad
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23832 - 23834
  • [3] Reinforcement Twinning: From digital twins to model-based reinforcement learning
    Schena, Lorenzo
    Marques, Pedro A.
    Poletti, Romain
    Van den Berghe, Jan
    Mendez, Miguel A.
    JOURNAL OF COMPUTATIONAL SCIENCE, 2024, 82
  • [4] OPTIMIZING HUMANITARIAN LOGISTICS WITH DEEP REINFORCEMENT LEARNING AND DIGITAL TWINS
    Soykan, Bulent
    Rabadia, Ghaith
    2024 ANNUAL MODELING AND SIMULATION CONFERENCE, ANNSIM 2024, 2024,
  • [5] Dynamic Process Planning using Digital Twins and Reinforcement Learning
    Mueller-Zhang, Zai
    Antonin, Pablo Oliveira
    Kuhn, Thomas
    2020 25TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2020, : 1757 - 1764
  • [6] Enhancing cut selection through reinforcement learning
    Wang, Shengchao
    Chen, Liang
    Niu, Lingfeng
    Dai, Yu-Hong
    SCIENCE CHINA-MATHEMATICS, 2024, 67 (06) : 1377 - 1394
  • [7] Enhancing cut selection through reinforcement learning
    Shengchao Wang
    Liang Chen
    Lingfeng Niu
    Yu-Hong Dai
    Science China(Mathematics), 2024, 67 (06) : 1377 - 1394
  • [8] Information Gain Regulation In Reinforcement Learning With The Digital Twins' Level of Realism
    Szabo, Geza
    Peto, Jozsef
    Nemeth, Levente
    Vidacs, Attila
    2020 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2020,
  • [9] On the Limits of Digital Twins for Safe Deep Reinforcement Learning in Robotic Networks
    Balghouthi, Mohamed Iheb
    Chiariotti, Federico
    Bedogni, Luca
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [10] Comparison of Reinforcement and Imitation Learning algorithms in autonomous sailboat Digital Twins
    Mexas, Rodrigo P.
    Leta, Fabiana R.
    Clua, Esteban W. G.
    IEEE LATIN AMERICA TRANSACTIONS, 2022, 20 (09) : 2153 - 2161