LEARNING MODEL-FREE ROBUST PRECODING FOR COOPERATIVE MULTIBEAM SATELLITE COMMUNICATIONS

被引:4
|
作者
Gracla, Steffen [1 ]
Bockelmann, Carsten [1 ]
Schroder, Alea [1 ]
Wubben, Dirk [1 ]
Roper, Maik [1 ]
Dekorsy, Armin [1 ]
机构
[1] Univ Bremen, Dept Communicat Engn, Bremen, Germany
关键词
Multi-user beamforming; 3D networks; Low Earth Orbit (LEO); Machine Learning (ML); deep Reinforcement Learning (RL);
D O I
10.1109/ICASSPW59220.2023.10193092
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Direct Low Earth Orbit satellite-to-handheld links are expected to be part of a new era in satellite communications. Space-Division Multiple Access precoding is a technique that reduces interference among satellite beams, therefore increasing spectral efficiency by allowing cooperating satellites to reuse frequency. Over the past decades, optimal precoding solutions with perfect channel state information have been proposed for several scenarios, whereas robust precoding with imperfect channel state information has mostly been studied for simplified models. Such simplified models might not be accurate particularly for Low Earth Orbit satellite applications. In this paper, we use the function approximation capabilities of the Soft Actor-Critic deep Reinforcement Learning algorithm to learn robust precoding with no knowledge of the system imperfections.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Model-Free Trajectory Optimization for Reinforcement Learning
    Akrour, Riad
    Abdolmaleki, Abbas
    Abdulsamad, Hany
    Neumann, Gerhard
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [42] Model-Free Active Exploration in Reinforcement Learning
    Russo, Alessio
    Proutiere, Alexandre
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [43] Model-Free Quantum Control with Reinforcement Learning
    Sivak, V. V.
    Eickbusch, A.
    Liu, H.
    Royer, B.
    Tsioutsios, I
    Devoret, M. H.
    PHYSICAL REVIEW X, 2022, 12 (01)
  • [44] Robust Model-Free Adaptive Iterative Learning Control for Vibration Suppression Based on Evidential Reasoning
    Bai, Liang
    Feng, Yun-Wen
    Li, Ning
    Xue, Xiao-Feng
    MICROMACHINES, 2019, 10 (03)
  • [45] On Robust Model-Free Reduced-Dimensional Reinforcement Learning Control for Singularly Perturbed Systems
    Mukherjee, Sayak
    Bai, He
    Chakrabortty, Aranya
    2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 3914 - 3919
  • [46] Model-free Policy Learning with Reward Gradients
    Lan, Qingfong
    Tosatto, Samuele
    Farrahi, Homayoon
    Mahmood, A. Rupam
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [47] Model-free learning control for unstable system
    Ribeiro, CHC
    Hemerly, EM
    ELECTRONICS LETTERS, 1998, 34 (21) : 2070 - 2071
  • [48] Model-Free Imitation Learning with Policy Optimization
    Ho, Jonathan
    Gupta, Jayesh K.
    Ermon, Stefano
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [49] Model-Free Reinforcement Learning Algorithms: A Survey
    Calisir, Sinan
    Pehlivanoglu, Meltem Kurt
    2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
  • [50] Recovering Robustness in Model-Free Reinforcement Learning
    Venkataraman, Harish K.
    Seiler, Peter J.
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 4210 - 4216