MARL-Based Multi-Satellite Intelligent Task Planning Method

被引:4
|
作者
Zhang, Guohui [1 ]
Li, Xinhong [1 ]
Hu, Gangxuan [1 ]
Li, Yanyan [1 ]
Wang, Xun [1 ]
Zhang, Zhibin [1 ]
机构
[1] Space Engn Univ, Dept Aerosp Sci & Technol, Beijing 101416, Peoples R China
关键词
Task analysis; Satellites; Planning; Markov processes; Games; Reinforcement learning; Predictive models; MARL; multi-satellite intelligent task planning; Markov game; MAPPO;
D O I
10.1109/ACCESS.2023.3337358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we propose a solution to multi-satellite intelligent task planning using the multi-agent reinforcement learning (MARL) method. Fristly, we have developed a multi-satellite task planning model based on the Markov game framework. Furthermore, we have computationally designed a satellite state transition function to address the task planning problem and successfully solved it using the multi-agent proximal policy optimization (MAPPO) algorithm. Our experimental results demonstrate that the MARL method exhibits remarkable convergence speed and performance, delivering significant rewards in multi-scale task planning scenarios. Consequently, it proves to be a highly suitable approach for multi-satellite intelligent task planning.
引用
收藏
页码:135517 / 135528
页数:12
相关论文
共 50 条
  • [1] A multi-satellite autonomous coordination task planning method based on bidding mechanism
    Chen T.
    Feng X.
    Chen J.
    Li Y.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2019, 51 (04): : 138 - 145
  • [2] A Multi-Satellite Multi-Target Observation Task Planning and Replanning Method Based on DQN
    Xing, Xiaoyu
    Wang, Shuyi
    Liu, Wenjing
    Liu, Chengrui
    SENSORS, 2025, 25 (06)
  • [3] Autonomous Task Planning Method for Multi-Satellite System Based on a Hybrid Genetic Algorithm
    Long, Jun
    Wu, Shimin
    Han, Xiaodong
    Wang, Yunbo
    Liu, Limin
    AEROSPACE, 2023, 10 (01)
  • [4] An Improved Multi-Satellite Cooperative Task Planning Method Based on Distributed Multi-agent System
    Long, Jun
    Qian, Zheman
    Xie, Fang
    Ding, Zhen
    Liu, Liming
    2021 13TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA 2021), 2021, : 539 - 542
  • [5] Multi-satellite task offloading method based on distributed deep learning
    Zhou Jinwen
    Liu Naijin
    Chen Qingxia
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2023, 43 (02) : 73 - 80
  • [6] A novel multi-satellite and multi-task scheduling method based on task network graph aggregation
    Fan, Huilong
    Yang, Zhan
    Zhang, Xi
    Wu, Shimin
    Long, Jun
    Liu, Limin
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 205
  • [7] Research on Multi-satellite Observation Multi-region Task Planning based on Genetic Algorithm
    Zhang, Ying
    Wang, Jianwei
    Yuan, Bo
    Wang, Chao
    Shi, Lei
    3RD INTERNATIONAL CONFERENCE ON AEROSPACE TECHNOLOGY, COMMUNICATIONS AND ENERGY SYSTEMS (ATCES 2019), 2019, 685
  • [8] A Multi-Objective Modeling Method of Multi-Satellite Imaging Task Planning for Large Regional Mapping
    Chen, Yaxin
    Xu, Miaozhong
    Shen, Xin
    Zhang, Guo
    Lu, Zezhong
    Xu, Junfei
    REMOTE SENSING, 2020, 12 (03)
  • [9] Multi-Satellite Imaging Task Planning for Large Regional Coverage: A Heuristic Algorithm Based on Triple Grids Method
    Li, Feng
    Wan, Qiuhua
    Wen, Feifei
    Zou, Yongkui
    He, Qien
    Li, Da
    Zhong, Xing
    Garzelli, Andrea
    REMOTE SENSING, 2024, 16 (01)
  • [10] Multi-satellite observation scheduling based on task clustering
    Wu, Guohua
    Ma, Manhao
    Wang, Huilin
    Qiu, Dishan
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2011, 32 (07): : 1275 - 1282