Reinforcement Learning-Based Pose Coordination Planning Capture Strategy for Space Non-Cooperative Targets

被引:0
|
作者
Peng, Zhaotao [1 ]
Wang, Chen [1 ]
机构
[1] Changan Univ, Sch Construct Machinery, Xian 710054, Peoples R China
关键词
non-cooperative space targets; space robots; reinforcement learning; capture strategy; cooperative planning for position and orientation; ROBOT; DYNAMICS;
D O I
10.3390/aerospace11090706
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
During the process of capturing non-cooperative targets in space, space robots have strict constraints on the position and orientation of the end-effector. Traditional methods typically focus only on the position control of the end-effector, making it difficult to simultaneously satisfy the precise requirements for both the capture position and posture, which can lead to failed or unstable grasping actions. To address this issue, this paper proposes a reinforcement learning-based capture strategy learning method combined with posture planning. First, the structural models and dynamic models of the capture mechanism are constructed. Then, an end-to-end decision control model based on the Optimistic Actor-Critic (OAC) algorithm and integrated with a capture posture planning module is designed. This allows the strategy learning process to reasonably plan the posture of the end-effector to adapt to the complex constraints of the target capture task. Finally, a simulation test environment is established on the Mujoco platform, and training and validation are conducted. The simulation results demonstrate that the model can effectively approach and capture multiple targets with different postures, verifying the effectiveness of the proposed method.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Autonomous reinforcement learning control for space robot to capture non-cooperative targets
    Liu Shuai
    Wu ShuNan
    Liu YuFei
    Wu ZhiGang
    Mao ZiMing
    SCIENTIA SINICA-PHYSICA MECHANICA & ASTRONOMICA, 2019, 49 (02)
  • [2] A Reinforcement Learning Capture Strategy for Non-cooperative Targets Based on a Multi-arm Synergy Method
    Zhang B.
    Wang C.
    Peng Z.
    Zhang Y.
    Zhang F.
    Yuhang Xuebao/Journal of Astronautics, 2023, 44 (12): : 1934 - 1943
  • [3] Learning-Based Pose Estimation of Non-Cooperative Spacecrafts with Uncertainty Prediction
    Li, Kecen
    Zhang, Haopeng
    Hu, Chenyu
    AEROSPACE, 2022, 9 (10)
  • [4] Pose Measurement Method of Space Non-Cooperative Targets Based on TOF Camera
    Sun Dianqi
    Duan Huixian
    Pei Haodong
    Hu Liang
    ACTA OPTICA SINICA, 2021, 41 (22)
  • [5] Utilizing deep reinforcement learning for tactile-based autonomous capture of non-cooperative objects in space
    Beigomi B.
    Zhu Z.H.
    Aerospace Systems, 2024, 7 (02) : 251 - 260
  • [6] Pose Estimation of Non-cooperative Targets Based on Docking Surface
    Du, Wenkai
    Liu, Zongming
    Zhang, Yu
    Cao, Shuqing
    Sang, Nong
    OPTICAL PATTERN RECOGNITION XXVI, 2015, 9477
  • [7] Monocular-Based Pose Estimation of Non-Cooperative Space Targets Using EKF and EKPF
    Jin, Zeming
    Wang, Ling
    Liu, Hanhan
    Du, Ronghua
    Zhang, Xiang
    2020 13TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2020), 2020, : 46 - 51
  • [8] Monocular-based Pose Estimation of Non-cooperative Space Targets Using EKF and EKPF
    Jin, Ze-Ming
    Wang, Ling
    Liu, Ke
    Du, Rong-Hua
    Zhang, Xiang
    Yuhang Xuebao/Journal of Astronautics, 2021, 42 (07): : 907 - 916
  • [9] Relative Pose Estimation of Non-Cooperative Space Targets Using a TOF Camera
    Sun, Dianqi
    Hu, Liang
    Duan, Huixian
    Pei, Haodong
    REMOTE SENSING, 2022, 14 (23)
  • [10] Reinforcement Learning-Based Satellite Attitude Stabilization Method for Non-Cooperative Target Capturing
    Ma, Zhong
    Wang, Yuejiao
    Yang, Yidai
    Wang, Zhuping
    Tang, Lei
    Ackland, Stephen
    SENSORS, 2018, 18 (12)