Cooperative Multi-Target Positioning for Cell-Free Massive MIMO With Multi-Agent Reinforcement Learning

被引:0
|
作者
Liu, Ziheng [1 ,2 ]
Zhang, Jiayi [1 ,2 ]
Shi, Enyu [1 ,2 ]
Zhu, Yiyang [1 ,2 ]
Ng, Derrick Wing Kwan [3 ]
Ai, Bo [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Frontiers Sci Ctr Smart High Speed Railway Syst, Beijing 100044, Peoples R China
[3] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
基金
中国国家自然科学基金;
关键词
Computer architecture; Wireless communication; Scalability; Artificial neural networks; Estimation; Computational complexity; Accuracy; Reinforcement learning; Databases; Channel estimation; Cell-free massive MIMO; cooperative WKNN; multi-agent reinforcement learning; user positioning; COMMUNICATION; TECHNOLOGIES; OPTIMIZATION; NETWORKS;
D O I
10.1109/TWC.2024.3478232
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cell-free massive multiple-input multiple-output (mMIMO) is a promising technology to empower next-generation mobile communication networks. In this paper, to address the computational complexity associated with conventional fingerprint positioning, we consider a novel cooperative positioning architecture that involves certain relevant access points (APs) to establish positioning similarity coefficients. Then, we propose an innovative joint positioning and correction framework employing multi-agent reinforcement learning (MARL) to tackle the challenges of high-dimensional sophisticated signal processing, which mainly leverages on the received signal strength information for preliminary positioning, supplemented by the angle of arrival information to refine the initial position estimation. Moreover, to mitigate the bias effects originating from remote APs, we design a cooperative weighted K-nearest neighbor (Co-WKNN)-based estimation scheme to select APs with a high correlation to participate in user positioning. In the numerical results, we present comparisons of various user positioning schemes, which reveal that the proposed MARL-based positioning scheme with Co-WKNN can effectively improve positioning performance. It is important to note that the cooperative positioning architecture is a critical element in striking a balance between positioning performance and computational complexity.
引用
收藏
页码:19034 / 19049
页数:16
相关论文
共 50 条
  • [11] Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learning
    Zhou, Wenhong
    LI, Jie
    Liu, Zhihong
    Shen, Lincheng
    CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (07) : 100 - 112
  • [12] Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems
    Cai, Tianzhang
    Wang, Qichen
    Zhang, Shuai
    Demir, Ozlem Tugfe
    Cavdar, Cicek
    2024 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING FOR COMMUNICATION AND NETWORKING, ICMLCN 2024, 2024, : 480 - 485
  • [13] Distributed Beam Selection for Millimeter-Wave Cell-Free Massive MIMO Based on Multi-Agent Deep Reinforcement Learning
    Li, Yuxuan
    Zhang, Cheng
    Huang, Yongming
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [14] Double-Layer Power Control for Mobile Cell-Free XL-MIMO With Multi-Agent Reinforcement Learning
    Liu, Ziheng
    Zhang, Jiayi
    Liu, Zhilong
    Xiao, Huahua
    Ai, Bo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (05) : 4658 - 4674
  • [15] Multi-Agent Uncertainty Sharing for Cooperative Multi-Agent Reinforcement Learning
    Chen, Hao
    Yang, Guangkai
    Zhang, Junge
    Yin, Qiyue
    Huang, Kaiqi
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [16] Training Cooperative Agents for Multi-Agent Reinforcement Learning
    Bhalla, Sushrut
    Subramanian, Sriram G.
    Crowley, Mark
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 1826 - 1828
  • [17] Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning
    Wang, Xin
    Zhao, Chen
    Huang, Tingwen
    Chakrabarti, Prasun
    Kurths, Juergen
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2023, 9 : 13 - 23
  • [18] Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-Enabled Multi-Agent Reinforcement Learning
    Wang, Shengbo
    Lin, Chuan
    Han, Guangjie
    Zhu, Shengchao
    Li, Zhixian
    Wang, Zhenyu
    Ma, Yunpeng
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (05) : 4296 - 4311
  • [19] Scalable AP Clustering With Deep Reinforcement Learning for Cell-Free Massive MIMO
    Tsukamoto, Yu
    Ikami, Akio
    Murakami, Takahide
    Amrallah, Amr
    Shinbo, Hiroyuki
    Amano, Yoshiaki
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2025, 6 : 1552 - 1567
  • [20] Deep Reinforcement Learning for Energy Efficiency Maximization in Cache-Enabled Cell-Free Massive MIMO Networks: Single- and Multi-Agent Approaches
    Chuang, Yu-Chieh
    Chiu, Wei-Yu
    Chang, Ronald Y.
    Lai, Yi-Cheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10826 - 10839