LEARNING MODEL-FREE ROBUST PRECODING FOR COOPERATIVE MULTIBEAM SATELLITE COMMUNICATIONS

被引:4
|
作者
Gracla, Steffen [1 ]
Bockelmann, Carsten [1 ]
Schroder, Alea [1 ]
Wubben, Dirk [1 ]
Roper, Maik [1 ]
Dekorsy, Armin [1 ]
机构
[1] Univ Bremen, Dept Communicat Engn, Bremen, Germany
关键词
Multi-user beamforming; 3D networks; Low Earth Orbit (LEO); Machine Learning (ML); deep Reinforcement Learning (RL);
D O I
10.1109/ICASSPW59220.2023.10193092
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Direct Low Earth Orbit satellite-to-handheld links are expected to be part of a new era in satellite communications. Space-Division Multiple Access precoding is a technique that reduces interference among satellite beams, therefore increasing spectral efficiency by allowing cooperating satellites to reuse frequency. Over the past decades, optimal precoding solutions with perfect channel state information have been proposed for several scenarios, whereas robust precoding with imperfect channel state information has mostly been studied for simplified models. Such simplified models might not be accurate particularly for Low Earth Orbit satellite applications. In this paper, we use the function approximation capabilities of the Soft Actor-Critic deep Reinforcement Learning algorithm to learn robust precoding with no knowledge of the system imperfections.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Robust Model-Free Multiclass Probability Estimation
    Wu, Yichao
    Zhang, Hao Helen
    Liu, Yufeng
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2010, 105 (489) : 424 - 436
  • [22] Model-Free Reinforcement Learning for Fully Cooperative Multi-Agent Graphical Games
    Zhang, Qichao
    Zhao, Dongbin
    Lewis, Frank L.
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [23] Unsupervised Model-Free Representation Learning
    Ryabko, Daniil
    ALGORITHMIC LEARNING THEORY (ALT 2013), 2013, 8139 : 354 - 366
  • [24] Learning model-free motor control
    Agostini, A
    Celaya, E
    ECAI 2004: 16TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 110 : 947 - 948
  • [25] MODEL-FREE LEARNING FROM DEMONSTRATION
    Billing, Erik A.
    Hellstrom, Thomas
    Janlert, Lars-Erik
    ICAART 2010: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 2: AGENTS, 2010, : 62 - 71
  • [26] Model-free reinforcement learning for robust locomotion using demonstrations from trajectory optimization
    Bogdanovic, Miroslav
    Khadiv, Majid
    Righetti, Ludovic
    FRONTIERS IN ROBOTICS AND AI, 2022, 9
  • [27] Robust Kinodynamic Motion Planning using Model-Free Game-Theoretic Learning
    Kontoudis, George P.
    Vamvoudakis, Kyriakos G.
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 273 - 278
  • [28] Deep Learning-Based Joint Channel Prediction and Multibeam Precoding for LEO Satellite Internet of Things
    Ying, Ming
    Chen, Xiaoming
    Qi, Qiao
    Gerstacker, Wolfgang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 13946 - 13960
  • [29] Robust Model-Free Multi-Object Tracking with Online Kernelized Structural Learning
    Yao, Rui
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (12) : 2401 - 2405
  • [30] Dynamic Event-Triggered Model-Free Reinforcement Learning for Cooperative Control of Multiagent Systems
    Wang, Ke
    Tang, Zhuo
    Mu, Chaoxu
    IEEE TRANSACTIONS ON RELIABILITY, 2024,