Optimal shape morphing control of 4D printed shape memory polymer based on reinforcement learning

被引:27
作者
Ji, Qinglei [1 ,2 ]
Chen, Mo [1 ]
Wang, Xi Vincent [1 ]
Wang, Lihui [1 ]
Feng, Lei [2 ]
机构
[1] KTH Royal Inst Technol, Dept Prod Engn, S-10044 Stockholm, Sweden
[2] KTH Royal Inst Technol, Dept Machine Design, S-10044 Stockholm, Sweden
基金
瑞典研究理事会;
关键词
4D printing; Shape Memory Polymer; Closed loop control; Reinforcement learning; PERFORMANCE; ACTUATOR;
D O I
10.1016/j.rcim.2021.102209
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
4D printing technology, as a new generation of Additive Manufacturing methods, enables printed objects to further change their shapes or other properties upon external stimuli. One main category of 4D printing research is 4D printed thermal Shape Memory Polymer (SMP). Its morphing process has large time delay, is nonlinear time variant, and susceptible to unpredictable disturbances. Reaching an arbitrary position with high precision is an active research question. This paper applies the Reinforcement Learning (RL) method to develop an optimal control method to perform closed loop control of the SMP actuation. Precise and prompt shape morphing is achieved compared with previous control methods using a PI controller. The training efforts of RL are further reduced by simplifying the optimal control policy using the structural property of the prior trained results. Customized protective visors against COVID-19 are fabricated using the proposed control method.
引用
收藏
页数:11
相关论文
共 41 条
[1]  
[Anonymous], 2004, Optimal Control Theory: An Introduction, DOI DOI 10.1109/TAC.1972.1100008
[2]   One-Step Process for Creating Triple-Shape Capability of AB Polymer Networks [J].
Behl, Marc ;
Bellin, Ingo ;
Kelch, Steffen ;
Wagermaier, Wolfgang ;
Lendlein, Andreas .
ADVANCED FUNCTIONAL MATERIALS, 2009, 19 (01) :102-108
[3]   Deep Reinforcement Learning for Soft, Flexible Robots: Brief Review with Impending Challenges [J].
Bhagat, Sarthak ;
Banerjee, Hritwick ;
Tse, Zion Tsz Ho ;
Ren, Hongliang .
ROBOTICS, 2019, 8 (01)
[4]   4D Printing Self-Morphing Structures [J].
Bodaghi, Mahdi ;
Noroozi, Reza ;
Zolfagharian, Ali ;
Fotouhi, Mohamad ;
Norouzi, Saeed .
MATERIALS, 2019, 12 (08)
[5]   Reinforcement learning for control: Performance, stability, and deep approximators [J].
Busoniu, Lucian ;
de Bruin, Tim ;
Tolic, Domagoj ;
Kober, Jens ;
Palunko, Ivana .
ANNUAL REVIEWS IN CONTROL, 2018, 46 :8-28
[6]   Active curved surface deforming of flexible conformal electronics by multi-fingered actuator [J].
Chen, Jiankui ;
Yang, Sihui ;
Li, Yiqun ;
Huang, Yongan ;
Yin, Zhouping .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2020, 64
[7]   Study on Efficient Fused Deposition Modelling of Thermoplastic Polyurethane Inflatable Wall Features for Airtightness [J].
Chen, Mo ;
Ji, Qinglei ;
Zhang, Xiran ;
Feng, Lei ;
Wang, Xi Vincent ;
Wang, Lihui .
SPS2020, 2020, 13 :417-427
[8]  
Chen T.-C.T., ROBOT COMPUT INTEGRA, V67
[9]   4D printing of high performance shape memory polymer using stereolithography [J].
Choong, Yu Ying Clarrisa ;
Maleksaeedi, Saeed ;
Eng, Hengky ;
Wei, Jun ;
Su, Pei-Chen .
MATERIALS & DESIGN, 2017, 126 :219-225
[10]   Direct 4D printing via active composite materials [J].
Ding, Zhen ;
Yuan, Chao ;
Peng, Xirui ;
Wang, Tiejun ;
Qi, H. Jerry ;
Dunn, Martin L. .
SCIENCE ADVANCES, 2017, 3 (04)