Multimodal Learning for Integrated Sensing and Communication Networks

被引:0
|
作者
Liu, Xiaonan [1 ]
Ratnarajah, Tharmalingam [1 ]
Sellathurai, Mathini [2 ]
Eldar, Yonina C. [3 ]
机构
[1] Univ Edinburgh, Sch Engn, Edinburgh, Midlothian, Scotland
[2] Heriot Watt Univ, Dept Engn & Phys Sci, Edinburgh, Midlothian, Scotland
[3] Weizmann Inst Sci, Fac Math & Comp Sci, Rehovot, Israel
关键词
Integrated sensing and communication; multimodal learning; RADAR; EDGE;
D O I
10.23919/EUSIPCO63174.2024.10715410
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Integrated sensing and communication (ISAC) is a promising technique for beyond 5G networks. In ISAC networks, the sensed environmental data may be multimodal data, which may result in high computation and communication latency due to the large size of data modalities and limited computation capability of mobile devices. To solve the problem, in this paper, we propose multimodal learning in ISAC networks. Simulation results show that the proposed multimodal learning design significantly outperforms several benchmarks without considering multimodal data sensing and communication.
引用
收藏
页码:1177 / 1181
页数:5
相关论文
共 50 条
  • [41] A modified deep learning based MIMO communication for integrated sensing, communication and computing systems
    Duan, Chaowei
    Zhang, Jian
    DIGITAL SIGNAL PROCESSING, 2023, 142
  • [42] Federated Learning for Distributed Spectrum Sensing in NextG Communication Networks
    Shi, Yi
    Sagduyu, Yalin E.
    Erpek, Tugba
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS IV, 2022, 12113
  • [43] Deep Learning-Based Design of Uplink Integrated Sensing and Communication
    Qi, Qiao
    Chen, Xiaoming
    Zhong, Caijun
    Yuen, Chau
    Zhang, Zhaoyang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 10639 - 10652
  • [44] Distributed Unsupervised Learning for Interference Management in Integrated Sensing and Communication Systems
    Liu, Xiangnan
    Zhang, Haijun
    Long, Keping
    Nallanathan, Arumugam
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (12) : 9301 - 9312
  • [45] A DEEP REINFORCEMENT LEARNING APPROACH FOR INTEGRATED AUTOMOTIVE RADAR SENSING AND COMMUNICATION
    Xu, Lifan
    Zheng, Ruxin
    Sun, Shunqiao
    2022 IEEE 12TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2022, : 316 - 320
  • [46] Deep Learning Enabled Precoding in Secure Integrated Sensing and Communication Systems
    Li, Ruize
    Bao, Chongyu
    Chen, Lu
    Wu, Fengjing
    Xia, Wenchao
    IEEE COMMUNICATIONS LETTERS, 2024, 28 (12) : 2769 - 2773
  • [47] Reinforcement Learning based Integrated Sensing and Communication for Automotive MIMO Radar
    Zhai, Weitong
    Wang, Xiangrong
    Greco, Maria S.
    Gini, Fulvio
    2023 IEEE RADAR CONFERENCE, RADARCONF23, 2023,
  • [48] Learning-Based Resource Management in Integrated Sensing and Communication Systems
    Lu, Ziyang
    Gursoy, M. Cenk
    Mohan, Chilukuri K.
    Varshney, Pramod K.
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [49] Machine learning opportunities for integrated polarization sensing and communication in optical fibers
    Rode, Andrej
    Farsi, Mohammad
    Lauinger, Vincent
    Karlsson, Magnus
    Agrell, Erik
    Schmalen, Laurent
    Haeger, Christian
    OPTICAL FIBER TECHNOLOGY, 2025, 90
  • [50] Integrated Sensing and Backscatter Communication
    Galappaththige, Diluka
    Tellambura, Chintha
    Maaref, Amine
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2023, 12 (12) : 2043 - 2047