Learning Human Strategies for Tuning Cavity Filters with Continuous Reinforcement Learning

被引:1
作者
Wang, Zhiyang [1 ,2 ,3 ]
Ou, Yongsheng [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Prov Key Lab Robot & Intelligent Syst, Shenzhen 518055, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Hong Kong Macao Joint Lab Human Machine, Shenzhen 518055, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 05期
基金
中国国家自然科学基金;
关键词
cavity filters tuning; reinforcement learning; human strategies; MICROWAVE; NETWORKS;
D O I
10.3390/app12052409
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Learning to master human intentions and behave more humanlike is an ultimate goal for autonomous agents. To achieve that, higher requirements for intelligence are imposed. In this work, we make an effort to study the autonomous learning mechanism to solve complicated human tasks. The tuning task of cavity filters is studied, which is a common task in the communication industry. It is not only time-consuming, but also depends on the knowledge of tuning technicians. We propose an automatic tuning framework for cavity filters based on Deep Deterministic Policy Gradient and design appropriate reward functions to accelerate training. Simulation experiments are carried out to verify the applicability of the algorithm. This method can not only automatically tune the detuned filter from random starting position to meet the design requirements under certain circumstances, but also realize the transfer of learning skills to new situations, to a certain extent.
引用
收藏
页数:20
相关论文
共 37 条
[1]   Intelligent Tuning of Microwave Cavity Filters Using Granular Multi-Swarm Particle Swarm Optimization [J].
Bi, Leyu ;
Cao, Weihua ;
Hu, Wenkai ;
Wu, Min .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (12) :12901-12911
[2]  
Brys T, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P3352
[3]   Computer-Aided Tuning of Highly Lossy Microwave Filters Using Complex Coupling Matrix Decomposition and Extraction [J].
Das, Ranjan ;
Zhang, Qingfeng ;
Kandwal, Abhishek ;
Liu, Haiwen ;
Chen, Yifan .
IEEE ACCESS, 2018, 6 :57172-57179
[4]  
Dunsmore J, 1999, IEEE MTT-S, P1351, DOI 10.1109/MWSYM.1999.779638
[5]   Automated filter tuning using generalized low-pass prototype networks and gradient-based parameter extraction [J].
Harscher, P ;
Vahldieck, R ;
Amari, S .
IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2001, 49 (12) :2532-2538
[6]  
Harutyunyan A, 2015, PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS (AAMAS'15), P1913
[7]  
Hester T., 2017, ARXIV PREPRINT ARXIV
[8]  
HP Application, 1999, SIMPL FILT TUN US TI
[9]   Computer-aided diagnosis and tuning of cascaded coupled resonators filters [J].
Hsu, HT ;
Yao, HW ;
Zaki, KA ;
Atia, AE .
IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2002, 50 (04) :1137-1145
[10]  
Kacmajor T., 2011, IEEE MTT S INT MICRO, P1, DOI [10.1109/MWSYM.2011.5972771, DOI 10.1109/MWSYM.2011.5972771]