IoT Sensor Gym: Training Autonomous IoT Devices with Deep Reinforcement Learning

被引:3
作者
Murad, Abdulmajid [1 ]
Kraemer, Frank Alexander [1 ]
Bach, Kerstin [1 ]
Taylor, Gavin [2 ]
机构
[1] Norwegian Univ Sci & Technol, NTNU, Trondheim, Norway
[2] US Naval Acad, Annapolis, MD 21402 USA
来源
PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON THE INTERNET OF THINGS ( IOT 2019) | 2019年
关键词
Deep Reinforcement Learning; Internet of Things; IoT; Embedded Systems; Energy Management;
D O I
10.1145/3365871.3365911
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We describe IoT Sensor Gym, a framework to train the behavior of constrained IoT devices using deep reinforcement learning. We focus on the main architectural choices to align problems from the IoT domain with cutting-edge reinforcement learning algorithms and exemplify our results with the autonomous control of a solar-powered IoT device.
引用
收藏
页数:4
相关论文
共 8 条
[1]  
[Anonymous], 2016, INT C MACH LEARN
[2]   The Arcade Learning Environment: An Evaluation Platform for General Agents [J].
Bellemare, Marc G. ;
Naddaf, Yavar ;
Veness, Joel ;
Bowling, Michael .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2013, 47 :253-279
[3]   Towards Cognitive IoT: Autonomous Prediction Model Selection for Solar-Powered Nodes [J].
Braten, Anders Eivind ;
Kraemer, Frank Alexander .
2018 IEEE INTERNATIONAL CONGRESS ON INTERNET OF THINGS (ICIOT), 2018, :118-125
[4]  
Brockman Greg, 2016, arXiv
[5]   Scaling Configuration of Energy Harvesting Sensors with Reinforcement Learning [J].
Fraternali, Francesco ;
Balaji, Bharathan ;
Gupta, Rajesh .
PROCEEDINGS OF THE 2018 INTERNATIONAL WORKSHOP ON ENERGY HARVESTING & ENERGY-NEUTRAL SENSING SYSTEMS (ENSSYS '18), 2018, :7-13
[6]   Solar Energy Prediction for Constrained IoT Nodes Based on Public Weather Forecasts [J].
Kraemer, Frank Alexander ;
Ammar, Doreid ;
Braten, Anders Eivind ;
Tamkittikhun, Nattachart ;
Palma, David .
IOT'17: PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON THE INTERNET OF THINGS, 2017, :8-15
[7]   Autonomous Management of Energy-Harvesting IoT Nodes Using Deep Reinforcement Learning [J].
Murad, Abdulmajid ;
Kraemer, Frank Alexander ;
Bach, Kerstin ;
Taylor, Gavin .
2019 IEEE 13TH INTERNATIONAL CONFERENCE ON SELF-ADAPTIVE AND SELF-ORGANIZING SYSTEMS (SASO), 2019, :43-51
[8]  
Schulman John, 2017, arXiv