Multi-Head Transformer Architecture with Higher Dimensional Feature Representation for Massive MIMO CSI Feedback

被引:0
|
作者
Chen, Qing [1 ]
Guo, Aihuang [1 ]
Cui, Yaodong [1 ]
机构
[1] Tongji Univ, Sch Elect & Informat Engn, Shanghai 201800, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 04期
关键词
CSI feedback; massive MIMO; deep learning; Transformer; attention mechanism; COMPRESSION; NETWORK;
D O I
10.3390/app14041356
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To achieve the anticipated performance of massive multiple input multiple output (MIMO) systems in wireless communication, it is imperative that the user equipment (UE) accurately feeds the channel state information (CSI) back to the base station (BS) along the uplink. To reduce the feedback overhead, an increasing number of deep learning (DL)-based networks have emerged, aimed at compressing and subsequently recovering CSI. Various novel structures are introduced, among which Transformer architecture has enabled a new level of precision in CSI feedback. In this paper, we propose a new method named TransNet+ built upon the Transformer-based TransNet by updating the multi-head attention layer and implementing an improved training scheme. The simulation results demonstrate that TransNet+ outperforms existing methods in terms of recovery accuracy and achieves state-of-the-art.
引用
收藏
页数:11
相关论文
共 10 条
  • [1] An Effective Network With Discrete Latent Representation Designed for Massive MIMO CSI Feedback
    Sun, Xinran
    Zhang, Zhengming
    Li, Chunguo
    Huang, Yongming
    Yang, Luxi
    IEEE COMMUNICATIONS LETTERS, 2024, 28 (11) : 2648 - 2652
  • [2] A Novel Approach Using Convolutional Transformer for Massive MIMO CSI Feedback
    Bi, Xiaojun
    Li, Shuo
    Yu, Changdong
    Zhang, Yu
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (05) : 1017 - 1021
  • [3] Disentangled Representation Learning Empowered CSI Feedback Using Implicit Channel Reciprocity in FDD Massive MIMO
    Xu, Wei
    Wu, Jie
    Jin, Shi
    You, Xiaohu
    Lu, Zhaohua
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 15169 - 15184
  • [4] Transformer-Assisted Parametric CSI Feedback for mmWave Massive MIMO Systems
    Ju, Hyungyu
    Jeong, Seokhyun
    Kim, Seungnyun
    Lee, Byungju
    Shim, Byonghyo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 18774 - 18787
  • [5] Transformer Empowered CSI Feedback for Massive MIMO Systems
    Xu, Yang
    Yuan, Mingqi
    Pun, Man-On
    2021 30TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2021), 2021, : 157 - 161
  • [6] Multi-Task Training Approach for CSI Feedback in Massive MIMO Systems
    Zhang, Boyuan
    Li, Haozhen
    Liang, Xin
    Gu, Xinyu
    Zhang, Lin
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (01) : 200 - 204
  • [7] Multi-resolution CSI Feedback with Deep Learning in Massive MIMO System
    Lu, Zhilin
    Wang, Jintao
    Song, Jian
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [8] Auto-CsiNet: Scenario-Customized Automatic Neural Network Architecture Generation for Massive MIMO CSI Feedback
    Li, Xiangyi
    Guo, Jiajia
    Wen, Chao-Kai
    Jin, Shi
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 14759 - 14775
  • [9] Deep Learning-Based CSI Feedback for Beamforming in Single- and Multi-Cell Massive MIMO Systems
    Guo, Jiajia
    Wen, Chao-Kai
    Jin, Shi
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (07) : 1872 - 1884
  • [10] Speech Emotion Classification with Parallel Architecture of Deep Learning and Multi-Head Attention Transformer
    Nguyen, An Hoang
    Trang, Kien
    Thao, Nguyen Gia Minh
    Vuong, Bao Quoc
    Ton-That, Long
    2023 62ND ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS, SICE, 2023, : 1549 - 1554