Market Model for Resource Allocation in Emerging Sensor Networks with Reinforcement Learning

被引:1
作者
Zhang, Yue [1 ]
Song, Bin [1 ]
Zhang, Ying [1 ]
Du, Xiaojiang [2 ]
Guizani, Mohsen [3 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA
[3] Univ Idaho, Dept Elect & Comp Engn, Moscow, ID 83844 USA
基金
高等学校博士学科点专项科研基金; 中国国家自然科学基金;
关键词
agent-based modelling; emerging sensor networks; Internet of Things; market model; reinforcement learning; resource allocation; topology management; SOCIAL INTERNET; VEHICLES; THINGS;
D O I
10.3390/s16122021
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Emerging sensor networks (ESNs) are an inevitable trend with the development of the Internet of Things (IoT), and intend to connect almost every intelligent device. Therefore, it is critical to study resource allocation in such an environment, due to the concern of efficiency, especially when resources are limited. By viewing ESNs as multi-agent environments, we model them with an agent-based modelling (ABM) method and deal with resource allocation problems with market models, after describing users' patterns. Reinforcement learning methods are introduced to estimate users' patterns and verify the outcomes in our market models. Experimental results show the efficiency of our methods, which are also capable of guiding topology management.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches
    Chang, Zheng
    Deng, Hengwei
    You, Li
    Min, Geyong
    Garg, Sahil
    Kaddoum, Georges
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05): : 2940 - 2951
  • [22] Dynamic Clustering and Resource Allocation Using Deep Reinforcement Learning for Smart-Duplex Networks
    Wang, Dan
    Huang, Chuan
    Zhang, Han
    Jiang, Shengpei
    Shi, Guowei
    Li, Tengfei
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (01) : 42 - 56
  • [23] RADEAN: A Resource Allocation Model Based on Deep Reinforcement Learning and Generative Adversarial Networks in Edge Computing
    Yu, Zhaoyang
    Zhao, Sinong
    Su, Tongtong
    Liu, Wenwen
    Liu, Xiaoguang
    Wang, Gang
    Wang, Zehua
    Leung, Victor C. M.
    MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES, MOBIQUITOUS 2023, PT I, 2024, 593 : 257 - 277
  • [24] Resource allocation of English intelligent learning system based on reinforcement learning
    Jin Jingbo
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (04) : 6839 - 6852
  • [25] Distributed resource management in wireless sensor networks using reinforcement learning
    Shah, Kunal
    Di Francesco, Mario
    Kumar, Mohan
    WIRELESS NETWORKS, 2013, 19 (05) : 705 - 724
  • [26] Distributed resource management in wireless sensor networks using reinforcement learning
    Kunal Shah
    Mario Di Francesco
    Mohan Kumar
    Wireless Networks, 2013, 19 : 705 - 724
  • [27] Resource Allocation in UAV-Assisted Wireless Networks Using Reinforcement Learning
    Luong, Phuong
    Gagnon, Francois
    Labeau, Fabrice
    2020 IEEE 92ND VEHICULAR TECHNOLOGY CONFERENCE (VTC2020-FALL), 2020,
  • [28] Federated Reinforcement Learning for Resource Allocation in V2X Networks
    Xu, Kaidi
    Zhou, Shenglong
    Li, Geoffrey Ye
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2024, 18 (07) : 1210 - 1221
  • [29] Reinforcement Learning on Computational Resource Allocation of Cloud-based Wireless Networks
    Chen, Beiran
    Zhang, Yi
    Iosifidis, George
    Liu, Mingming
    2020 IEEE 6TH WORLD FORUM ON INTERNET OF THINGS (WF-IOT), 2020,
  • [30] Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks
    Zhao, Nan
    Liang, Ying-Chang
    Niyato, Dusit
    Pei, Yiyang
    Wu, Minghu
    Jiang, Yunhao
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (11) : 5141 - 5152