Online control of stencil printing parameters using reinforcement learning approach

被引:18
作者
Khader, Nourma [1 ]
Yoon, Sang Won [1 ]
机构
[1] SUNY Binghamton, Dept Syst Sci & Ind Engn, Binghamton, NY 13905 USA
来源
28TH INTERNATIONAL CONFERENCE ON FLEXIBLE AUTOMATION AND INTELLIGENT MANUFACTURING (FAIM2018): GLOBAL INTEGRATION OF INTELLIGENT MANUFACTURING AND SMART INDUSTRY FOR GOOD OF HUMANITY | 2018年 / 17卷
关键词
Surface mount technology; Stencil printing process; Reinforcement learning; Q-learning; PASTE; HYBRID; SYSTEM; OPTIMIZATION; QUALITY;
D O I
10.1016/j.promfg.2018.10.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research proposes a novel approach to control the stencil printing process (SPP) parameters online in surface mount technology (SMT) of printed circuit boards (PCBs). Several external variables induce variations in stencil printing quality including environment conditions, operator faults, and others. This research aims to build an optimal adaptive controller that captures these variations and consequently adjusts the controllable and significant printing parameters to enhance the solder paste volume transfer efficiency (TE) during actual production run. Q-learning which is a reinforcement learning (RL) approach is used to control the main printing parameters (printing speed and pressure, and the separation speed) online. The results show that Q-learning converges to the optimal policy for the SPP problem, and the optimal sets of actions for different states are retrieved using Q-table. Moreover, the developed controller is capable to reach the terminal state for several testing examples with taking few actions. (C) 2018 The Authors. Published by Elsevier B.V.
引用
收藏
页码:94 / 101
页数:8
相关论文
共 36 条
[1]  
Amir D., 1994, Surface Mount International Conference and Exposition. Proceedings of the Technical Program, P691
[2]   Characterization of the solder paste release from small stencil apertures in the stencil printing process [J].
Aravamudhan, S ;
Santos, D ;
Pham-Van-Diep, G ;
Andres, F .
JOURNAL OF ELECTRONIC PACKAGING, 2005, 127 (03) :340-352
[3]   Reinforcement learning-based multi-agent system for network traffic signal control [J].
Arel, I. ;
Liu, C. ;
Urbanik, T. ;
Kohls, A. G. .
IET INTELLIGENT TRANSPORT SYSTEMS, 2010, 4 (02) :128-135
[4]   Dynamic job-shop scheduling using reinforcement learning agents [J].
Aydin, ME ;
Öztemel, E .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2000, 33 (2-3) :169-178
[5]  
Barajas L., 2001, Circuits Assembly, V12, P32
[6]   Stencil printing process modeling and control using statistical neural networks [J].
Barajas, Leandro G. ;
Egerstedt, Magnus B. ;
Kamen, Edward W. ;
Goldstein, Alex .
IEEE TRANSACTIONS ON ELECTRONICS PACKAGING MANUFACTURING, 2008, 31 (01) :9-18
[7]  
Barajas LeandroG., 2002, Proc. Surf. Mount Technol. Assoc. Int. Conf.(SMTA), P51
[8]  
Christopher John Cornish HellabyWatkins, 1989, THESIS
[9]  
Da He, 1998, IEEE Transactions on Components, Packaging & Manufacturing Technology, Part C (Manufacturing), V21, P317, DOI 10.1109/3476.739177
[10]   Manufacturing Scheduling Using Colored Petri Nets and Reinforcement Learning [J].
Drakaki, Maria ;
Tzionas, Panagiotis .
APPLIED SCIENCES-BASEL, 2017, 7 (02)