Mission planning for distributed multiple agile Earth observing satellites by attention-based deep reinforcement learning method

被引:3
|
作者
Li, Peiyan [1 ]
Wang, Huiquan [1 ]
Zhang, Yongxing [1 ]
Pan, Ruixue [2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
[2] Shanghai Inst Satellite Engn, Shanghai 200240, Peoples R China
关键词
Multiple satellite collaboration; Fully distributed coordination system; Deep reinforcement learning; Agile earth observation satellites (AE- OSs); Mission planning; SCHEDULING ALGORITHMS; SYSTEMS;
D O I
10.1016/j.asr.2024.06.003
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The autonomous coordination and integrated planning of observation and data downlink missions for the distributed agile Earth observation satellite (AEOS) constellation hold significant importance in practical applications. In order to address this issue, we introduce an abstract universal mission model and present an algorithm rooted in deep reinforcement learning (DRL), termed the Attentionbased Distributed Satellite Mission Planning (ADSMP) algorithm, which is designed to generate effective planning solutions. This algorithm employs a neural network that utilizes the attention mechanism, enabling each satellite to independently make decisions with equal intelligence. Furthermore, a mission priority adjustment method is devised to facilitate the coordination of data download and observation scheduling. The ADSMP is trained using the REINFORCE algorithm with Rollout Baseline. By conducting comparative experiments, we demonstrate that the proposed algorithm attains the highest revenue rate in corresponding scenarios, while simultaneously ensuring fast inference speed. (c) 2024 COSPAR. Published by Elsevier B.V. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页码:2388 / 2404
页数:17
相关论文
共 50 条
  • [1] Deep reinforcement learning-based autonomous mission planning method for high and low orbit multiple agile Earth observing satellites
    Wang, Xin
    Wu, Jian
    Shi, Zhong
    Zhao, Fanyu
    Jin, Zhonghe
    ADVANCES IN SPACE RESEARCH, 2022, 70 (11) : 3478 - 3493
  • [2] Model and algorithm to mission planning of agile earth observing satellites
    Yao, Feng
    Xing, Li-Ning
    He, Ren-Jie
    Chen, Ying-Wu
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2013, 19 (05): : 1035 - 1040
  • [3] A New Method of Mission Planning for Area Target Scanning by Multiple Earth Observing Satellites
    Han, Peng
    Deng, Qing
    Li, Chuanjiang
    Zhu, He
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 1876 - 1881
  • [4] Heterogeneous mission planning for a single unmanned aerial vehicle (UAV) with attention-based deep reinforcement learning
    Jung, Minjae
    Oh, Hyondong
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [5] Heterogeneous mission planning for a single unmanned aerial vehicle (UAV) with attention-based deep reinforcement learning
    Jung M.
    Oh H.
    PeerJ Computer Science, 2022, 8
  • [6] Agile Earth Observing Satellites Mission Planning Using Genetic Algorithm Based on High Quality Initial Solutions
    Yuan, Zang
    Chen, Yingwu
    He, Renjie
    2014 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2014, : 603 - 609
  • [7] Mission Planning for Agile Earth Observing Satellite Based on Genetic Algorithm
    Han, Peng
    He, Zhiwen
    Geng, Yuanzhuo
    Guo, Yanning
    Li, Chuanjiang
    Zhao, Guangdong
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 2118 - 2123
  • [8] Iterated Bidding-based Autonomous Mission Planning of Multiple Agile Earth Observation Satellites
    Chen, Xiongzi
    Xie, Song
    Yu, Linghui
    Fan, Chunshi
    Sun, Xiaohan
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 5087 - 5092
  • [9] Attention-based Deep Multiple Instance Learning
    Ilse, Maximilian
    Tomczak, Jakub M.
    Welling, Max
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [10] Autonomous Command and Control for Earth-Observing Satellites using Deep Reinforcement Learning
    Harris, Andrew
    Naik, Kedar
    2023 IEEE AEROSPACE CONFERENCE, 2023,