Market Model for Resource Allocation in Emerging Sensor Networks with Reinforcement Learning

被引：1
作者：
Zhang, Yue [1 ]
Song, Bin [1 ]
Zhang, Ying [1 ]
Du, Xiaojiang [2 ]
Guizani, Mohsen [3 ]
机构：
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA
[3] Univ Idaho, Dept Elect & Comp Engn, Moscow, ID 83844 USA
来源：
SENSORS | 2016年 / 16卷 / 12期
基金：
高等学校博士学科点专项科研基金; 中国国家自然科学基金;
关键词：
agent-based modelling; emerging sensor networks; Internet of Things; market model; reinforcement learning; resource allocation; topology management; SOCIAL INTERNET; VEHICLES; THINGS;
D O I：
10.3390/s16122021
中图分类号：
O65 [分析化学];
学科分类号：
070302 ; 081704 ;
摘要：
Emerging sensor networks (ESNs) are an inevitable trend with the development of the Internet of Things (IoT), and intend to connect almost every intelligent device. Therefore, it is critical to study resource allocation in such an environment, due to the concern of efficiency, especially when resources are limited. By viewing ESNs as multi-agent environments, we model them with an agent-based modelling (ABM) method and deal with resource allocation problems with market models, after describing users' patterns. Reinforcement learning methods are introduced to estimate users' patterns and verify the outcomes in our market models. Experimental results show the efficiency of our methods, which are also capable of guiding topology management.
引用
收藏
页数：16
相关论文
共 50 条
[41]   Reinforcement Learning Enabled Dynamic Resource Allocation in the Internet of Vehicles [J].
Liang, Hongbin ;
Zhang, Xiaohui ;
Hong, Xintao ;
Zhang, Zongyuan ;
Li, Mushu ;
Hu, Guangdi ;
Hou, Fen .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) :4957-4967
[42]   Fast Reinforcement Learning Algorithms for Resource Allocation in Data Centers [J].
Jiang, Yuang ;
Kodialam, Murali ;
Lakshman, T., V ;
Mukherjee, Sarit ;
Tassiulas, Leandros .
2020 IFIP NETWORKING CONFERENCE AND WORKSHOPS (NETWORKING), 2020, :271-279
[43]   Multi-band Environments for Optical Reinforcement Learning Gym for Resource Allocation in Elastic Optical Networks [J].
Morales, Patricia ;
Franco, Patricia ;
Lozada, Astrid ;
Jara, Nicolas ;
Calderon, Felipe ;
Pinto-Rios, Juan ;
Leiva, Ariel .
2021 INTERNATIONAL CONFERENCE ON OPTICAL NETWORK DESIGN AND MODELLING (ONDM), 2021,
[44]   A Local Collaborative Distributed Reinforcement Learning Approach for Resource Allocation in V2X Networks [J].
Zhang, Yue ;
Tan, Guoping ;
Zhou, Siyuan .
WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT II, 2021, 12938 :442-454
[45]   Collective reinforcement learning based resource allocation for digital twin service in 6G networks [J].
Huang, Zhongwei ;
Li, Dagang ;
Cai, Jun ;
Lu, Hua .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2023, 217
[46]   Computation Offloading and Resource Allocation in Satellite-Terrestrial Integrated Networks: A Deep Reinforcement Learning Approach [J].
Xie, Junfeng ;
Jia, Qingmin ;
Chen, Youxing ;
Wang, Wei .
IEEE ACCESS, 2024, 12 :97184-97195
[47]   Distributed Deep Reinforcement Learning Based Mode Selection and Resource Allocation for VR Transmission in Edge Networks [J].
Luo, Jie ;
Liu, Bei ;
Gao, Hui ;
Su, Xin .
COMMUNICATIONS AND NETWORKING (CHINACOM 2021), 2022, :153-167
[48]   Meta-Hierarchical Reinforcement Learning (MHRL)-Based Dynamic Resource Allocation for Dynamic Vehicular Networks [J].
He, Ying ;
Wang, Yuhang ;
Lin, Qiuzhen ;
Li, Jianqiang .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (04) :3495-3506
[49]   A Fast Resource Allocation Algorithm Based on Reinforcement Learning in Edge Computing Networks Considering User Cooperation [J].
Jin, Yichen ;
Chen, Ziwei .
ELECTRONICS, 2023, 12 (06)
[50]   Multiagent Deep-Reinforcement-Learning-Based Resource Allocation for Heterogeneous QoS Guarantees for Vehicular Networks [J].
Tian, Jie ;
Liu, Qianqian ;
Zhang, Haixia ;
Wu, Dalei .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (03) :1683-1695
12345