RLC: A Reinforcement Learning-Based Charging Algorithm for Mobile Devices

被引:19
|
作者
Liu, Tang [1 ,2 ]
Wu, Baijun [3 ]
Xu, Wenzheng [4 ]
Cao, Xianbo [4 ]
Peng, Jian [4 ]
Wu, Hongyi [5 ]
机构
[1] Sichuan Normal Univ, 5 Jingan Rd, Chengdu 610066, Peoples R China
[2] State Key Lab Networking & Switching Technol, 10 Xitucheng Rd, Beijing 100876, Peoples R China
[3] Univ Louisiana Lafayette, 301 E Lewis St, Lafayette, LA 70503 USA
[4] Sichuan Univ, 24 South Sect 1,Yihuan Rd, Chengdu 610065, Peoples R China
[5] Old Dominion Univ, 231 Kaufman Hall, Norfolk, VA 23529 USA
基金
中国国家自然科学基金;
关键词
Hotspot-based wireless rechargeable networks; mobile devices; reinforcement learning; ENERGY;
D O I
10.1145/3453682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless charging has been demonstrated as a promising technology for prolonging device operational lifetimes in Wireless Rechargeable Networks (WRNs). To schedule a mobile charger to move along a pre-designed trajectory to charge devices, most existing studies assume that the precise location information of devices is already known. Unfortunately, this assumption does not always hold in real mobile application, because the activities of the vast majority of mobile devices carried by mobile agents appear dynamic and random. To the best of our knowledge, this is the first work to study how to wirelessly charge mobile devices with non-deterministic mobility. We aim to provide effective charging service to them, subject to the energy capacity of the mobile charger. We formalize the effective charging problem as a charging reward maximization problem (CRMP), where the amount of reward obtained by charging a device is inversely proportional to the residual lifetime of the device. Then, we prove that CRMP is NP-hard. To derive an effective charging heuristic, an algorithm based on Reinforcement Learning (RL) is proposed. The evaluation results show that the RL-based charging algorithm achieves excellent charging effectiveness. We further interpret the learned heuristic to gain deep and valuable insights into the design options.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Federated Learning-based Active Authentication on Mobile Devices
    Oza, Poojan
    Patel, Vishal M.
    2021 INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB 2021), 2021,
  • [22] Deep reinforcement learning-based antilock braking algorithm
    Mantripragada, V. Krishna Teja
    Kumar, R. Krishna
    VEHICLE SYSTEM DYNAMICS, 2023, 61 (05) : 1410 - 1431
  • [23] Reinforcement learning-based cell selection in sparse mobile crowdsensing
    Liu, Wenbin
    Wang, Leye
    Wang, En
    Yang, Yongjian
    Zeghlache, Djamal
    Zhang, Daqing
    COMPUTER NETWORKS, 2019, 161 : 102 - 114
  • [24] Reinforcement Learning-Based Tracking Control For Wheeled Mobile Robot
    Nguyen Tan Luy
    PROCEEDINGS 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2012, : 462 - 467
  • [25] Deep Reinforcement Learning-Based Method of Mobile Data Offloading
    Mochizuki, Daisuke
    Abiko, Yu
    Mineno, Hiroshi
    Saito, Takato
    Ikeda, Daizo
    Katagiri, Masaji
    2018 ELEVENTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORK (ICMU 2018), 2018,
  • [26] Reinforcement learning-based power control in mobile communications systems
    Gao, XZ
    Ovaska, SJ
    Vasilakos, AV
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2002, 8 (04): : 337 - 352
  • [27] Practical considerations in reinforcement learning-based MPC for mobile robots
    Busetto, Riccardo
    Breschi, Valentina
    Vaccari, Giulio
    Formentin, Simone
    IFAC PAPERSONLINE, 2023, 56 (02): : 5787 - 5792
  • [28] Reinforcement learning-based charging cluster determination algorithm for optimal charger placement in wireless rechargeable sensor networks
    Wang, Haoran
    Li, Jinglin
    Xiao, Wendong
    AD HOC NETWORKS, 2024, 164
  • [29] Model for the reinforcement of learning with mobile devices
    Cantu-Cervantes, Daniel
    Amaya-Amaya, Arturo
    Rafael Baca-Pumarejo, Jose
    CIENCIAUAT, 2019, 13 (02) : 56 - 70
  • [30] Reinforcement Learning-Based Vehicle-Cell Association Algorithm for Highly Mobile Millimeter Wave Communication
    Khan, Hamza
    Elgabli, Anis
    Samarakoon, Sumudu
    Bennis, Mehdi
    Hong, Choong Seon
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (04) : 1073 - 1085