Real-Time Melt Pool Homogenization Through Geometry-Informed Control in Laser Powder Bed Fusion Using Reinforcement Learning

This paper presents a real-time geometry-informed control strategy to homogenize melt pool measurements in laser powder bed fusion (L-PBF) using reinforcement learning. The learning control strategy incorporates geometric information of the scan path as well as in-situ melt pool measurements to compute the laser power signal for reducing in-process melt pool inhomogeneities. First, we design and validate a data-driven model to train the reinforcement learning agent in simulation, with the goal of reducing the amount of experimental data needed for training. Using this simulation-based training approach has the added benefit of avoiding unsafe or infeasible experiments, an issue that is often encountered in training the reinforcement learning agent. After training, the learned control strategy attenuates the 1-norm error by 37% and standard deviation by 39% in simulation. We then deploy this learned control strategy in an experimental test bed for a new scan geometry. In this test scenario, the policy achieves a 30% reduction in error, and a 36% reduction in melt pool signal variation, thereby illustrating the potential of reinforcement learning in real-time geometry-agnostic control for L-PBF. Finally, we demonstrate that the reinforcement learning agent delivers the same level of performance as a model-based feedforward controller with PID feedback, with 20x less computational time for a single geometry.