Gain-Based Feedback for Shape Control of Antenna Reflectors Using Deep Q-Network Algorithm

被引:0
|
作者
Zhang, Zehua [1 ]
Chu, Weimeng [2 ,3 ]
Ma, Qingnan [1 ]
Song, Xiangshuai [1 ]
Liu, Dakai [1 ]
Wu, Xiande [1 ]
机构
[1] Harbin Engn Univ, Coll Aerosp & Civil Engn, Harbin 150001, Peoples R China
[2] Sun Yat Sen Univ, Sch Aeronaut & Astronaut, Guangzhou 518107, Peoples R China
[3] Natl Univ Singapore, Dept Mech Engn, Singapore 119260, Singapore
基金
中国国家自然科学基金;
关键词
Influence Coefficients; Numerical Simulation; Piezoelectric Actuators; Reflector Antennas; Shape Control; Reinforcement Learning;
D O I
10.2514/1.J064547
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
An intelligent shape control method for antenna reflectors is proposed using gain feedback instead of displacement feedback, considering the limitations of high-precision deformation measurement on orbit. Moreover, the finite element method is used to establish an analysis model of a grid reflector with embedded piezoelectric actuators, and the antenna gain formula is derived. To solve the multidimensional control laws from a single gain dimension, an active shape control model training framework is proposed based on the deep Q-network algorithm, including the state space, action space, and reward function. Numerical simulations, with errors stemming from two typical thermal loads as the initial errors, are conducted to illustrate the effect of the proposed control method. The influence of the voltage step size on the shape control precision is analyzed, and further online training is discussed for implementing control. The results indicate that the proposed method reduces the root-mean-square (RMS) error by more than 50% The control effect of the trained control model on other error conditions does not perform as desired. However, online training can effectively solve this problem, achieving faster convergence and a significant reduction of the RMS error.
引用
收藏
页码:1120 / 1130
页数:11
相关论文
共 50 条
  • [1] Adaptive Shape Control for Antenna Reflectors Based on Feedback Error Learning Algorithm
    Song, Xiangshuai
    Chu, Weimeng
    Tan, Shujun
    Wu, Zhigang
    Qi, Zhaohui
    AIAA JOURNAL, 2020, 58 (07) : 3229 - 3240
  • [2] Safe Navigation Based on Deep Q-Network Algorithm Using an Improved Control Architecture
    Marouane, Chetioui
    Saad, Babesse
    PROGRAM OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATIC CONTROL, ICEEAC 2024, 2024,
  • [3] A New Feature Selection Algorithm Based on Deep Q-Network
    Li, Xinqian
    Yao, Jie
    Ren, Jia
    Wang, Liqiang
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7100 - 7105
  • [4] Data driven control based on Deep Q-Network algorithm for heading control and of a in calm water and waves
    Sivaraj, Sivaraman
    Rajendran, Suresh
    Prasad, Lokukaluge Perera
    OCEAN ENGINEERING, 2022, 259
  • [5] Feedback shape control for deployable mesh reflectors using gain scheduling method
    Xie, Yangmin
    Shi, Hang
    Alleyne, Andrew
    Yang, Bingen
    ACTA ASTRONAUTICA, 2016, 121 : 241 - 255
  • [6] Feedback stabilization of probabilistic finite state machines based on deep Q-network
    Tian, Hui
    Su, Xin
    Hou, Yanfang
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2024, 18
  • [7] Deep Q-Network Using Reward Distribution
    Nakaya, Yuta
    Osana, Yuko
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 160 - 169
  • [8] AGV dispatching algorithm based on deep Q-network in CNC machines environment
    Chang, Kyuchang
    Park, Seung Hwan
    Baek, Jun-Geol
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2022, 35 (06) : 662 - 677
  • [9] Tuning Apex DQN: A Reinforcement Learning based Deep Q-Network Algorithm
    Ruhela, Dhani
    Ruhela, Amit
    PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2024, PEARC 2024, 2024,
  • [10] The optimal dispatching strategy of cogeneration based on Deep Q-Network (DQN) algorithm
    Zhang, Pei
    Fu, Yan
    Yao, Fu
    SCIENCE AND TECHNOLOGY FOR ENERGY TRANSITION, 2024, 79