Applying Game-Learning Environments to Power Capping Scenarios via Reinforcement Learning

被引:2
|
作者
Hernandez, Pablo [1 ]
Costero, Luis [1 ]
Olcoz, Katzalin [1 ]
Igual, Francisco D. [1 ]
机构
[1] Univ Complutense Madrid, Dept Arquitectura Comp & Automat, Madrid, Spain
来源
CLOUD COMPUTING, BIG DATA & EMERGING TOPICS, JCC-BD&ET 2022 | 2022年 / 1634卷
关键词
Reinforcement Learning; RLLIB; GYM; Resource management; Power capping; DVFS; MANAGEMENT;
D O I
10.1007/978-3-031-14599-5_7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Research in deep learning for video game playing has received much attention and provided very relevant results in the last years. Frameworks and libraries have been developed to ease game playing research leveraging Reinforcement Learning techniques. In this paper, we propose to use two of them (RLLIB and GYM) in a very different scenario, such as learning to apply resource management policies in a multi-core server, specifically, we leverage the facilities of both frameworks coupled to derive policies for power-capping. Using RLlib and Gym enables implementing different resource management policies in a simple and fast way and, as they are based on neural networks, guarantees the efficiency in the solution, and the use of hardware accelerators for both training and inference. The results demonstrate that game-learning environments provide an effective support to cast a completely different scenario, and open new research avenues in the field of resource management using reinforcement learning techniques with minimal development effort.
引用
收藏
页码:91 / 106
页数:16
相关论文
共 50 条
  • [1] Applying Reinforcement Learning in Context Limited Environments
    Ferreira, Diogo
    Antunes, Mario
    Gomes, Diogo
    Aguiar, Rui L.
    PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL CONFERENCE ON HUMAN-MACHINE SYSTEMS (ICHMS), 2020, : 481 - 486
  • [2] Learning to Navigate in Human Environments via Deep Reinforcement Learning
    Gao, Xingyuan
    Sun, Shiying
    Zhao, Xiaoguang
    Tan, Min
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT I, 2019, 11953 : 418 - 429
  • [3] Resource Management in Multi-Cloud Scenarios via Reinforcement Learning
    Pietrabissa, Antonio
    Battilotti, Stefano
    Facchinei, Francisco
    Giuseppi, Alessandro
    Oddi, Guido
    Panfili, Martina
    Suraci, Vincenzo
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 9084 - 9089
  • [4] Exploiting semantic segmentation to boost reinforcement learning in video game environments
    Montalvo, Javier
    Garcia-Martin, Alvaro
    Bescos, Jesus
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (07) : 10961 - 10979
  • [5] Exploiting semantic segmentation to boost reinforcement learning in video game environments
    Javier Montalvo
    Álvaro García-Martín
    Jesús Bescós
    Multimedia Tools and Applications, 2023, 82 : 10961 - 10979
  • [6] PowerCoord: Power capping coordination for multi-CPU/GPU servers using reinforcement learning
    Azimi, Reza
    Jing, Chao
    Reda, Sherief
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2020, 28
  • [7] Observation Encoding for Reinforcement Learning Agents in 3D Game Environments
    Haase, Lennart
    Fischoeder, Nicolas
    Vatolkin, Igor
    2024 IEEE CONFERENCE ON GAMES, COG 2024, 2024,
  • [8] An Adaptive Strategy via Reinforcement Learning for the Prisoner's Dilemma Game
    Lei Xue
    Changyin Sun
    Donald Wunsch
    Yingjiang Zhou
    Fang Yu
    IEEE/CAA Journal of Automatica Sinica, 2018, (01) : 301 - 310
  • [9] An Adaptive Strategy via Reinforcement Learning for the Prisoner's Dilemma Game
    Xue, Lei
    Sun, Changyin
    Wunsch, Donald
    Zhou, Yingjiang
    Yu, Fang
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2018, 5 (01) : 301 - 310
  • [10] Reinforcement Learning for Repeated Power Control Game in Cognitive Radio Networks
    Zhou, Pan
    Chang, Yusun
    Copeland, John A.
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2012, 30 (01) : 54 - 69