Constrained Deep Reinforcement Learning for Fronthaul Compression Optimization

被引:0
作者
Gronland, Axel [1 ,2 ]
Russo, Alessio [1 ]
Jedra, Yassir [1 ]
Klaiqi, Bleron [2 ]
Gelabert, Xavier [2 ]
机构
[1] Royal Inst Technol KTH, Stockholm, Sweden
[2] Stockholm Res Ctr, Huawei Technol Sweden AB, Stockholm, Sweden
来源
2024 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING FOR COMMUNICATION AND NETWORKING, ICMLCN 2024 | 2024年
关键词
C-RAN; fronthaul; machine learning; reinforcement learning; performance evaluation;
D O I
10.1109/ICMLCN59089.2024.10624764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the Centralized-Radio Access Network (C-RAN) architecture, functions can be placed in the central or distributed locations. This architecture can offer higher capacity and cost savings but also puts strict requirements on the fronthaul (FH), these constraints can be any number of constraints but in this work we consider a constraint on packet loss and latency. Adaptive FH compression schemes that adapt the compression amount to varying FH traffic are promising approaches to deal with stringent FH requirements. In this work, we design such a compression scheme using a model-free off policy deep reinforcement learning algorithm which accounts for FH latency and packet loss constraints. Furthermore, this algorithm is designed for model transparency and interpretability which is crucial for AI trustworthiness in performance critical domains. We show that our algorithm can successfully choose an appropriate compression scheme while satisfying the constraints and exhibits a roughly 70% increase in FH utilization compared to a reference scheme.
引用
收藏
页码:498 / 504
页数:7
相关论文
共 50 条
[11]   Deep Reinforcement Learning Based Joint Allocation Scheme in a TWDM-PON-Based mMIMO Fronthaul Network [J].
Cheng, Yuansen ;
Shao, Yingjie ;
Ding, Shifeng ;
Chan, Chun-Kit .
IEEE PHOTONICS JOURNAL, 2024, 16 (03)
[12]   Chance-Constrained Control With Lexicographic Deep Reinforcement Learning [J].
Giuseppi, Alessandro ;
Pietrabissa, Antonio .
IEEE CONTROL SYSTEMS LETTERS, 2020, 4 (03) :755-760
[13]   Ship Collision Avoidance Using Constrained Deep Reinforcement Learning [J].
Zhang, Rui ;
Wang, Xiao ;
Liu, Kezhong ;
Wu, Xiaolie ;
Lu, Tianyou ;
Chao Zhaohui .
2018 5TH INTERNATIONAL CONFERENCE ON BEHAVIORAL, ECONOMIC, AND SOCIO-CULTURAL COMPUTING (BESC), 2018, :115-120
[14]   From Reinforcement Learning to Deep Reinforcement Learning: An Overview [J].
Agostinelli, Forest ;
Hocquet, Guillaume ;
Singh, Sameer ;
Baldi, Pierre .
BRAVERMAN READINGS IN MACHINE LEARNING: KEY IDEAS FROM INCEPTION TO CURRENT STATE, 2018, 11100 :298-328
[15]   Constrained model-free reinforcement learning for process optimization [J].
Pan, Elton ;
Petsagkourakis, Panagiotis ;
Mowbray, Max ;
Zhang, Dongda ;
del Rio-Chanona, Ehecatl Antonio .
COMPUTERS & CHEMICAL ENGINEERING, 2021, 154
[16]   PrefixRL: Optimization of Parallel Prefix Circuits using Deep Reinforcement Learning [J].
Roy, Rajarshi ;
Raiman, Jonathan ;
Kant, Neel ;
Elkin, Ilyas ;
Kirby, Robert ;
Siu, Michael ;
Oberman, Stuart ;
Godil, Saad ;
Catanzaro, Bryan .
2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, :853-858
[17]   Cost Optimization at Early Stages of Design Using Deep Reinforcement Learning [J].
Servadei, Lorenzo ;
Zheng, Jiapeng ;
Arjona-Medina, Jose ;
Werner, Michael ;
Esen, Volkan ;
Hochreiter, Sepp ;
Ecker, Wolfgang ;
Wille, Robert .
PROCEEDINGS OF THE 2020 ACM/IEEE 2ND WORKSHOP ON MACHINE LEARNING FOR CAD (MLCAD '20), 2020, :37-42
[18]   Aircraft collision avoidance modeling and optimization using deep reinforcement learning [J].
Park K.-W. ;
Kim J.-H. .
Journal of Institute of Control, Robotics and Systems, 2021, 27 (09) :652-659
[19]   Optimization of uplink rate and fronthaul compression in cloud radio access networks [J].
Yu, Heejung ;
Kim, Taejoon .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 102 :465-471
[20]   A hierarchical constrained reinforcement learning for optimization of bitumen recovery rate in a primary separation vessel [J].
Shafi, Hareem ;
Velswamy, Kirubakaran ;
Ibrahim, Fadi ;
Huang, Biao .
COMPUTERS & CHEMICAL ENGINEERING, 2020, 140