Motion control for laser machining via reinforcement learning

被引:9
|
作者
Xie, Yunhui [1 ]
Praeger, Matthew [1 ]
Grant-Jacob, James A. [1 ]
Eason, Robert W. [1 ]
Mills, Ben [1 ]
机构
[1] Univ Southampton, Optoelect Res Ctr, Southampton SO17 1BJ, Hants, England
关键词
ABLATION;
D O I
10.1364/OE.454793
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Laser processing techniques such as laser machining, marking, cutting, welding, polishing and sintering have become important tools in modern manufacturing. A key step in these processes is to take the intended design and convert it into coordinates or toolpaths that are useable by the motion control hardware and result in efficient processing with a sufficiently high quality of finish. Toolpath design can require considerable amounts of skilled manual labor even when assisted by proprietary software. In addition, blind execution of predetermined toolpaths is unforgiving, in the sense that there is no compensation for machining errors that may compromise the quality of the final product. In this work, a novel laser machining approach is demonstrated, utilizing reinforcement learning (RL) to control and supervise the laser machining process. This autonomous RL-controlled system can laser machine arbitrary pre-defined patterns whilst simultaneously detecting and compensating for incorrectly executed actions, in real time. Published by Optica Publishing Group under the terms of the Creative Commons Attribution 4.0 License.
引用
收藏
页码:20963 / 20979
页数:17
相关论文
共 50 条
  • [1] Machining sequence learning via inverse reinforcement learning
    Sugisawa, Yasutomo
    Takasugi, Keigo
    Asakawa, Naoki
    PRECISION ENGINEERING-JOURNAL OF THE INTERNATIONAL SOCIETIES FOR PRECISION ENGINEERING AND NANOTECHNOLOGY, 2022, 73 : 477 - 487
  • [2] MOTION CONTROL OF A NONLINEAR SPRING BY REINFORCEMENT LEARNING
    Bucak, I. O.
    Zohdy, M. A.
    Shillor, M.
    CONTROL AND INTELLIGENT SYSTEMS, 2008, 36 (01)
  • [3] Reinforcement learning for motion control of humanoid robots
    Iida, S. (iida@ics.nitech.ac.jp), 2004, Institute of Electrical and Electronics Engineers, IEEE; Robotics Society of Japan, RSJ (Institute of Electrical and Electronics Engineers Inc.):
  • [4] Motion control of unmanned underwater vehicles via deep imitation reinforcement learning algorithm
    Chu, Zhenzhong
    Sun, Bo
    Zhu, Daqi
    Zhang, Mingjun
    Luo, Chaomin
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (07) : 764 - 774
  • [5] Motion Control for Biped Robot via DDPG-based Deep Reinforcement Learning
    Wu, Xiaoguang
    Liu, Shaowei
    Zhang, Tianci
    Yang, Lei
    Li, Yanhui
    Wang, Tingjin
    2018 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA), 2018, : 40 - 45
  • [6] Estimation of stochastic representation of via-points in human motion control by reinforcement learning
    Wada, Yasuhiro
    Tokunaga, Ken-ichi
    2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 1441 - +
  • [7] Phased learning with hierarchical reinforcement learning in nonholonomic motion control
    Goto, Takaknuni
    Homma, Noriyasu
    Yoshizawa, Makoto
    Abe, Kenichi
    2006 SICE-ICASE INTERNATIONAL JOINT CONFERENCE, VOLS 1-13, 2006, : 2200 - +
  • [8] Safety reinforcement learning control via transfer learning
    Zhang, Quanqi
    Wu, Chengwei
    Tian, Haoyu
    Gao, Yabin
    Yao, Weiran
    Wu, Ligang
    AUTOMATICA, 2024, 166
  • [9] Learning to Control Camera Exposure via Reinforcement Learning
    Lee, Kyunghyun
    Shin, Ukcheol
    Lee, Byeong-Uk
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 2975 - 2983
  • [10] Path planning via reinforcement learning with closed-loop motion control and field tests
    Feher, Arpad
    Domina, Adam
    Bardos, Adam
    Aradi, Szilard
    Becsi, Tamas
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 142