Improving Computational Complexity of Multi-Target Multi-Agent Reinforcement for Hyperspectral Satellite Sensor Tasking

被引:0
作者
Saeed, Amir K. [1 ]
Yasin, Alhassan S. [1 ]
Johnson, Benjamin A. [1 ]
Holguin, Francisco [1 ]
Rodriguez, Benjamin M. [1 ]
机构
[1] Johns Hopkins, Whiting Sch Engn Engn Professionals, Baltimore, MD 21218 USA
来源
PATTERN RECOGNITION AND PREDICTION XXXV | 2024年 / 13040卷
关键词
astrodynamics; hyperspectral imaging; !text type='python']python[!/text; reinforcement learning; transfer learning; multiagent; multi-target deep Q-Networks;
D O I
10.1117/12.3014065
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The study in this paper builds on previous research in reinforcement learning to address the challenges of computational complexity and scalability in multi-agent, multi-target satellite sensor tasking systems. Drawing on the groundwork laid by previous research conducted space-based hyperspectral imaging systems, novel approaches are introduced to optimize satellite tasking efficiency. The primary innovation is the implementation of a continuous space expansion method, which enhances system adaptability without necessitating intricate adjustments. Additionally, the study investigates transfer learning within larger state-action spaces, utilizing insights from smaller spaces to accelerate training in more extensive and intricate environments. Through a series of comprehensive experiments conducted in an enhanced physics-based Python simulation environment, the effectiveness and practicality of these strategies are confirmed. The outcomes reveal significant reductions in computational complexity in multi-agent, multi-target satellite tasking, rendering it more viable for real-world implementation. This research contributes to the advancement of AI-driven satellite tasking, enhancing its efficiency in managing extensive satellite constellations.
引用
收藏
页数:9
相关论文
共 6 条
[1]  
Gonzalez A., 2022, Astrodynamics with python
[2]  
Jin Chi, 2018, Advances in neural information processing systems, V31
[3]   Balancing effort and benefit of K-means clustering algorithms in Big Data realms [J].
Perez-Ortega, Joaquin ;
Nely Almanza-Ortega, Nelva ;
Romero, David .
PLOS ONE, 2018, 13 (09)
[4]  
Saeed A., 2024, Aerospace
[5]   Reinforcement Learning Application to Satellite Constellation Sensor Tasking [J].
Saeed, Amir ;
Holguin, Francisco ;
Gabriel, Jonathon ;
Yasin, Alhassan S. ;
Rodriguez, Benjamin M. .
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS V, 2023, 12538
[6]  
Sutton RS, 2018, ADAPT COMPUT MACH LE, P1