Beam Prediction Based on Large Language Models

被引:2
作者
Sheng, Yucheng [1 ]
Huang, Kai [1 ]
Liang, Le [1 ,2 ]
Liu, Peng [3 ]
Jin, Shi [1 ]
Ye Li, Geoffrey [4 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[2] Purple Mt Labs, Nanjing 211111, Peoples R China
[3] Huawei Technol Co Ltd, Shenzhen 518129, Peoples R China
[4] Imperial Coll London, Dept Elect & Elect Engn, ITP Lab, London SW7 2BX, England
关键词
Wireless communication; Time series analysis; Predictive models; Millimeter wave communication; Market research; Antennas; Training; Vocabulary; Robustness; Prototypes; Beam prediction; large language model; time series forecasting; cross attention;
D O I
10.1109/LWC.2025.3543567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we use large language models (LLMs) to develop a high-performing and robust beam prediction method. We formulate the millimeter wave (mmWave) beam prediction problem as a time series forecasting task, where the historical observations are aggregated through cross-variable attention and then transformed into text-based representations using a trainable tokenizer. By leveraging the prompt-as-prefix (PaP) technique for contextual enrichment, our method harnesses the power of LLMs to predict future optimal beams. Simulation results demonstrate that our LLM-based approach outperforms traditional learning-based models in prediction accuracy as well as robustness, highlighting the significant potential of LLMs in enhancing wireless communication systems.
引用
收藏
页码:1406 / 1410
页数:5
相关论文
共 12 条
[1]  
Alkhateeb A., 2019, P ITA, P1
[2]  
Bariah L, 2023, Arxiv, DOI arXiv:2306.10249
[3]   SEMANTIC COMMUNICATIONS USING FOUNDATION MODELS: DESIGN APPROACHES AND OPEN ISSUES [J].
Jiang, Peiwen ;
Wen, Chao-Kai ;
Yi, Xinping ;
Li, Xiao ;
Jin, Shi ;
Zhang, Jun .
IEEE WIRELESS COMMUNICATIONS, 2024, 31 (03) :76-84
[4]  
Jin M., 2024, P ICLR, P1
[5]   Machine Learning Based Time Domain Millimeter-Wave Beam Prediction for 5G-Advanced and Beyond: Design, Analysis, and Over-The-Air Experiments [J].
Li, Qiaoyu ;
Sisk, Philip ;
Kannan, Arumugam ;
Yoo, Taesang ;
Luo, Tao ;
Shah, Gaurav ;
Manjunath, Badri ;
Samarathungage, Chanaka ;
Boroujeni, Mahmoud Taherzadeh ;
Pezeshki, Hamed ;
Joshi, Himanshu .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (06) :1787-1809
[6]   Low-Complexity Hybrid Precoding in Massive Multiuser MIMO Systems [J].
Liang, Le ;
Xu, Wei ;
Dong, Xiaodai .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2014, 3 (06) :653-656
[7]   Continuous-Time mmWave Beam Prediction With ODE-LSTM Learning Architecture [J].
Ma, Ke ;
Zhang, Fan ;
Tian, Wenqiang ;
Wang, Zhaocheng .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2023, 12 (01) :187-191
[8]   Deep Learning Assisted mmWave Beam Prediction with Prior Low-frequency Information [J].
Ma, Ke ;
He, Dongxuan ;
Sun, Hancun ;
Wang, Zhaocheng .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
[9]  
Radford A., 2019, OpenAI Blog, V1
[10]   A STATISTICAL-MODEL FOR INDOOR MULTIPATH PROPAGATION [J].
SALEH, AAM ;
VALENZUELA, RA .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 1987, 5 (02) :128-137