Satellite Autonomous Mission Planning Based on Improved Monte Carlo Tree Search

被引:0
作者
Li, Zichao [1 ]
Li, You [1 ]
Luo, Rongzheng [2 ]
机构
[1] Xidian Univ, Sch Aerosp Sci & Technol, Xian 710126, Peoples R China
[2] China Acad Space Technol, Inst Remote Sensing Satellite, Beijing 100094, Peoples R China
来源
SYMMETRY-BASEL | 2024年 / 16卷 / 08期
关键词
Monte Carlo tree search; timeliness; autonomous mission planning;
D O I
10.3390/sym16081039
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This paper improves the timeliness of satellite mission planning to cope with the rapid response to changes. In this paper, satellite mission planning is investigated. Firstly, the satellite dynamics model and mission planning model are established, and an improved Monte Carlo tree (Improved-MCTS) algorithm is proposed, which utilizes the Monte Carlo tree search in combination with the state uncertainty network (State-UN) to reduce the time of exploring the nodes (At the MCTS selection stage, the exploration of nodes specifically refers to the algorithm needing to decide whether to choose nodes that have already been visited (exploitation) or nodes that have not been visited yet (exploration)). The results show that this algorithm performs better in terms of profit (in this paper, the observation task is given a weight of 0-1, and each planned task will receive a profit; that is, a profit will be assigned at the initial moment) and convergence speed compared to the ant colony algorithm (ACO) and the asynchronous advantage actor critic (A3C).
引用
收藏
页数:19
相关论文
共 22 条
  • [1] Beaumet G., 2008, P ISAIRAS LOS ANG CA
  • [2] An anytime branch and bound algorithm for agile earth observation satellite onboard scheduling
    Chu, Xiaogeng
    Chen, Yuning
    Tan, Yuejin
    [J]. ADVANCES IN SPACE RESEARCH, 2017, 60 (09) : 2077 - 2090
  • [3] Dilkina B., 2005, Agile Satellite Scheduling via Permutation Search with Constraint Propagation
  • [4] Simulation-Based Algorithms for Markov Decision Processes: Monte Carlo Tree Search from AlphaGo to AlphaZero
    Fu, Michael C.
    [J]. ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2019, 36 (06)
  • [5] Habet D., 2003, P 5 MET INT C
  • [6] Models and Strategies for J2-Perturbed Orbital Pursuit-Evasion Games
    Han, Hongyu
    Dang, Zhaohui
    [J]. SPACE: SCIENCE & TECHNOLOGY, 2023, 3
  • [7] Huang H., 2020, P 2020 INT C GUID AD, P579
  • [8] Orbital Interception Pursuit Strategy for Random Evasion Using Deep Reinforcement Learning
    Jiang, Rui
    Ye, Dong
    Xiao, Yan
    Sun, Zhaowei
    Zhang, Zeming
    [J]. SPACE: SCIENCE & TECHNOLOGY, 2023, 3
  • [9] Selecting and scheduling observations of agile satellites
    Lemaître, M
    Verfaillie, G
    Jouhaud, F
    Lachiver, JM
    Bataille, N
    [J]. AEROSPACE SCIENCE AND TECHNOLOGY, 2002, 6 (05) : 367 - 381
  • [10] Lematre M., 1997, P COMP ILOG INT US M