LLM4CP: Adapting Large Language Models for Channel Prediction

被引:5
作者
Liu, Boxun [1 ]
Liu, Xuanyu [1 ]
Gao, Shijian [2 ]
Cheng, Xiang [1 ]
Yang, Liuqing [2 ,3 ]
机构
[1] State Key Laboratory of Advanced Optical Communication Systems and Networks, School of Electronics, Peking University, Beijing
[2] The Hong Kong University of Science and Technology (Guangzhou), Guangzhou
[3] Department of Electronic and Computer Engineering and Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology
基金
中国国家自然科学基金;
关键词
channel prediction; fine-tuning; large language models (LLMs); massive multi-input multi-output (m-MIMO); time-series;
D O I
10.23919/JCIN.2024.10582829
中图分类号
学科分类号
摘要
Channel prediction is an effective approach for reducing the feedback or estimation overhead in massive multi-input multi-output (m-MIMO) systems. However, existing channel prediction methods lack precision due to model mismatch errors or network generalization issues. Large language models (LLMs) have demonstrated powerful modeling and generalization abil-ities, and have been successfully applied to cross-modal tasks, including the time series analysis. Leveraging the expressive power of LLMs, we propose a pre-trained LLM-empowered channel prediction (LLM4CP) method to predict the future downlink channel state information (CSI) sequence based on the historical uplink CSI sequence. We fine-tune the network while freezing most of the parameters of the pre-trained LLM for better cross-modality knowledge transfer. To bridge the gap between the channel data and the feature space of the LLM, preprocessor, embedding, and output modules are specifically tailored by taking into account unique channel characteristics. Simulations validate that the proposed method achieves state-of-the-art (SOTA) prediction performance on full-sample, few-shot, and generalization tests with low training and inference costs. © 2024, Posts and Telecom Press Co Ltd. All rights reserved.
引用
收藏
页码:113 / 125
页数:12
相关论文
共 42 条
[1]  
CHENG X, ZHANG H, ZHANG J, Et al., Intelligent multi-modal sensing-communication integration: synesthesia of machines, IEEE Communications Surveys and Tutorials, 26, 1, pp. 258-301, (2024)
[2]  
ZHANG H, GAO S, CHENG X, Et al., Integrated sensing and communications towards proactive beamforming in mmWave V2I via multi-modal feature fusion (MMFF), IEEE Transactions on Wireless Communications, (2024)
[3]  
CHUNG S T, GOLDSMITH A J., Degrees of freedom in adaptive mod-ulation: a unified view, IEEE Transactions on Communications, 49, 9, pp. 1561-1571, (2001)
[4]  
SADR S, ANPALAGAN A, RAAHEMIFAR K., Radio resource allocation algorithms for the downlink of multiuser OFDM communication systems, IEEE Communications Surveys and Tutorials, 11, 3, pp. 92-106, (2009)
[5]  
GAO S, CHENG X, YANG L., Estimating doubly-selective channels for hybrid mmWave massive MIMO systems: a doubly-sparse approach, IEEE Transactions on Wireless Communications, 19, 9, pp. 5703-5715, (2020)
[6]  
MA X, GIANNAKIS G B, OHNO S., Optimal training for block transmissions over doubly selective wireless fading channels, IEEE Transactions on Signal Processing, 51, 5, pp. 1351-1366, (2003)
[7]  
ROTTENBERG F, CHOI T, LUO P, Et al., Performance analysis of channel extrapolation in FDD massive MIMO systems, IEEE Transactions on Wireless Communications, 19, 4, pp. 2728-2741, (2020)
[8]  
CHOI T, ROTTENBERG F, GOMEZ-PONCE J, Et al., Experimen-tal investigation of frequency domain channel extrapolation in massive MIMO systems for zero-feedback FDD, IEEE Transactions on Wireless Communications, 20, 1, pp. 710-725, (2020)
[9]  
ARNOLD M, DORNER S, CAMMERER S, Et al., Towards practical FDD massive MIMO: CSI extrapolation driven by deep learning and actual channel measurements, Proceedings of 2019 53rd Asilomar Conference on Signals, Systems, and Computers, pp. 1972-1976, (2019)
[10]  
TRUONG K T, HEATH R W., Effects of channel aging in massive MIMO systems, Journal of Communications and Networks, 15, 4, pp. 338-351, (2013)