Reliable and Energy-Efficient Communications in Mobile Robotic Networks by Collaborative Beamforming

被引:1
作者
He, Min [1 ,2 ]
Chen, Yali [1 ]
Liu, Min [3 ,4 ,5 ]
Fan, Xiaokun [1 ,2 ]
Zhu, Yuchen [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Comp Technol, Network Technol Res Ctr, Beijing, Peoples R China
[4] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing, Peoples R China
[5] Zhongguancun Lab, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Collaborative beamforming; distributed reinforcement learning; energy efficiency; mobile robotic networks; reliable communications; WIRELESS SENSOR NETWORKS; INDUSTRIAL INTERNET; SIDELOBE CONTROL; OPTIMIZATION; PERFORMANCE; DESIGN; TRENDS;
D O I
10.1145/3678011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For mobile robotic networks in industrial scenarios, reliable and energy-efficient communications are crucial yet challenging. Fortunately, collaborative beamforming (CB) emerges as a promising solution, which can increase the transmission gain and reduce the transmit power of robots by constructing a mobile robot-enabled virtual antenna array (MRVAA). The performance of CB is tightly related to robot positions, necessitating proper robot selection. However, robot selection may expose the network to the risk of unbalanced energy distribution, reducing network lifetime. Additionally, the mobility and variable numbers of robots require flexible and scalable robot selection algorithms. To tackle these challenges, we first formulate a multi-objective optimization problem to reduce the maximum sidelobe level (MSLL) of MRVAA while minimizing the standard deviation of the network energy distribution (SDNED) by selecting robots for CB. Then, based on distributed multi-agent learning (MARL), we propose an effective and scalable robot selection algorithm with energy considered (RoSE) to solve the problem, where difference-rewards function (DRF) and policy sharing are designed for enhancing convergence rate and policy stability. Simulation results show that the RoSE has the scalability to positions and numbers of robots. Furthermore, RoSE surpasses existing selection algorithms in network lifetime and time efficiency, while still maintaining comparable MSLL.
引用
收藏
页数:24
相关论文
共 46 条
  • [21] Joint Data Transmission and Energy Harvesting for MISO Downlink Transmission Coordination in Wireless IoT Networks
    Liu, Jain-Shing
    Lin, Chun-Hung
    Hu, Yu-Chen
    Donta, Praveen Kumar
    [J]. SENSORS, 2023, 23 (08)
  • [22] Joint Beamforming, Power Allocation, and Splitting Control for SWIPT-Enabled IoT Networks with Deep Reinforcement Learning and Game Theory
    Liu, JainShing
    Lin, Chun-Hung Richard
    Hu, Yu-Chen
    Donta, Praveen Kumar
    [J]. SENSORS, 2022, 22 (06)
  • [23] Improved Routing Protocol Based on Multiobjective Optimization in Industrial Robot Networks
    Liu, You Wu
    Alias, Syazwina Binti
    Liu, Ming-yue
    Jiao, Bian-bian
    [J]. ADVANCES IN MULTIMEDIA, 2022, 2022
  • [24] Deployment of mobile robots with energy and timing constraints
    Mei, Yongguo
    Lu, Yung-Hsiang
    Hu, Y. Charlie
    Lee, C. S. George
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2006, 22 (03) : 507 - 522
  • [25] Human-level control through deep reinforcement learning
    Mnih, Volodymyr
    Kavukcuoglu, Koray
    Silver, David
    Rusu, Andrei A.
    Veness, Joel
    Bellemare, Marc G.
    Graves, Alex
    Riedmiller, Martin
    Fidjeland, Andreas K.
    Ostrovski, Georg
    Petersen, Stig
    Beattie, Charles
    Sadik, Amir
    Antonoglou, Ioannis
    King, Helen
    Kumaran, Dharshan
    Wierstra, Daan
    Legg, Shane
    Hassabis, Demis
    [J]. NATURE, 2015, 518 (7540) : 529 - 533
  • [26] Nguyen DucT., 2018, Advances Neural Inf. Process. Syst.., P8113
  • [27] Collaborative beamforming for distributed wireless ad hoc sensor networks
    Ochiai, H
    Mitran, P
    Poor, HV
    Tarokh, V
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2005, 53 (11) : 4110 - 4124
  • [28] Minimal Energy Path Planning for Wireless Robots
    Ooi, Chia Ching
    Schindelhauer, Christian
    [J]. MOBILE NETWORKS & APPLICATIONS, 2009, 14 (03) : 309 - 321
  • [29] Ozger M, 2018, IEEE GLOB COMM CONF
  • [30] Joint Optimization of Wireless Network Energy Consumption and Control System Performance in Wireless Networked Control Systems
    Sadi, Yalcin
    Ergen, Sinem Coleri
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2017, 16 (04) : 2235 - 2248