Resource Allocation Strategy for Virtualized Wireless Sensor Networks Based on Actor-Critic

被引:1
作者
Li, Changjin [1 ]
Zhou, Guangxu [1 ]
Guo, Yue [1 ]
Hou, Junfeng [1 ]
Zhang, Hongjun [1 ]
Li, Song [1 ]
机构
[1] Henan Prov Tobacco Co, Xuchang Branch, Xuchang 461000, Henan, Peoples R China
来源
2022 IEEE 21ST INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING AND COMMUNICATIONS, IUCC/CIT/DSCI/SMARTCNS | 2022年
关键词
virtual sensing network; virtual network mapping; markov decision process; resource allocation; INTERNET;
D O I
10.1109/IUCC-CIT-DSCI-SmartCNS57392.2022.00032
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Aiming at the problem of effective utilization of virtualized WSN resources, a reinforcement learning-based resource allocation strategy for virtualized WSNs is proposed from the perspective of service requests of virtualized WSNs. A virtual sensor network request deployment utility maximization model is established based on the quality requirements of service sensing information and resource capacity constraints. Considering the randomness of service requests and the dynamic changes in the network environment, the resource optimization problem is transformed into MDP and solved using Actor-Critic reinforcement learning methods, and the best resource allocation strategy is obtained. Finally, a large number of simulation experiments are carried out to verify the effectiveness of the proposed method.
引用
收藏
页码:132 / 139
页数:8
相关论文
共 17 条
[1]  
Bousnina S, 2017, IFIP WIREL DAY, P15, DOI 10.1109/WD.2017.7918108
[2]   Novel Node-Ranking Approach and Multiple Topology Attributes-Based Embedding Algorithm for Single-Domain Virtual Network Embedding [J].
Cao, Haotong ;
Yang, Longxiang ;
Zhu, Hongbo .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (01) :108-120
[3]  
Chen LS, 2020, INT CONF WIRE COMMUN, P32, DOI 10.1109/WCSP49889.2020.9299694
[4]   On optimal resource allocation in virtual sensor networks [J].
Delgado, Carmen ;
Ramon Gallego, Jose ;
Canales, Maria ;
Ortin, Jorge ;
Bousnina, Sonda ;
Cesana, Matteo .
AD HOC NETWORKS, 2016, 50 :23-40
[5]   A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients [J].
Grondman, Ivo ;
Busoniu, Lucian ;
Lopes, Gabriel A. D. ;
Babuska, Robert .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (06) :1291-1307
[6]   Game Theoretical Analysis of Service Provision for the Internet of Things Based on Sensor Virtualization [J].
Guijarro, Luis ;
Pla, Vicent ;
Vidal, Jose-Ramon ;
Naldi, Maurizio .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2017, 35 (03) :691-706
[7]   An Efficient Sensor Deployment Scheme for Large-Scale Wireless Sensor Networks [J].
Kim, Hoon ;
Han, Sang-wook .
IEEE COMMUNICATIONS LETTERS, 2015, 19 (01) :98-101
[8]   On Construction of Sensors, Edge, and Cloud (iSEC) Framework for Smart System Integration and Applications [J].
Kristiani, Endah ;
Yang, Chao-Tung ;
Huang, Chin-Yin ;
Ko, Po-Cheng ;
Fathoni, Halim .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (01) :309-319
[9]   A Review of Internet of Things-Resource Allocation [J].
Li, Xuemei ;
Xu, Li Da .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (11) :8657-8666
[10]   Resource Allocation in Wireless Powered Virtualized Sensor Networks [J].
Li, Zhidu ;
Zhong, Ailing .
IEEE ACCESS, 2020, 8 :40327-40336