SEQ2SEQ-SC: END-TO-END SEMANTIC COMMUNICATION SYSTEMS WITH PRE-TRAINED LANGUAGE MODEL

被引:3
|
作者
Lee, Ju-Hyung [1 ]
Lee, Dong-Ho [1 ]
Sheen, Eunsoo [1 ]
Choi, Thomas [1 ]
Pujara, Jay [1 ]
机构
[1] Univ Southern Calif, Los Angeles, CA 90007 USA
关键词
Semantic communication; natural language processing (NLP); link-level simulation;
D O I
10.1109/IEEECONF59524.2023.10476895
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we propose a realistic semantic network called seq2seq-SC, designed to be compatible with 5G NR and capable of working with generalized text datasets using a pre-trained language model. The goal is to achieve unprecedented communication efficiency by focusing on the meaning of messages in semantic communication. We employ a performance metric called semantic similarity, measured by BLEU for lexical similarity and SBERT for semantic similarity. Our findings demonstrate that seq2seq-SC outperforms previous models in extracting semantically meaningful information while maintaining superior performance. This study paves the way for continued advancements in semantic communication and its prospective incorporation with future wireless systems in 6G networks.
引用
收藏
页码:260 / 264
页数:5
相关论文
共 50 条
  • [41] Automatic and Flexible Transmission of Semantic Map Images using Polar Codes for End-to-End Semantic-based Communication Systems
    Rezaei, Hossein
    Sivalingam, Thushan
    Rajatheva, Nandana
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [42] Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and Their Enabling Semantic Applications
    Islam, Nazmul
    Shin, Seokjoo
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 4207 - 4240
  • [43] End-to-End Communication Challenges in M2M Systems for mHealth Applications
    Kartsakli, Elli
    Lalos, Aris S.
    Antonopoulos, Angelos
    Tennina, Stefano
    Di Renzo, Marco
    Alonso, Luis
    2014 IEEE 19TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2014, : 355 - 359
  • [44] A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-Language Model
    Xu, Mengde
    Zhang, Zheng
    Wei, Fangyun
    Lin, Yutong
    Cao, Yue
    Hu, Han
    Bai, Xiang
    COMPUTER VISION, ECCV 2022, PT XXIX, 2022, 13689 : 736 - 753
  • [45] A Novel End-To-End Learning Framework Based on Optimised Residual Gated Units and Stacked Pre-Trained Layers for Detection of Autism Spectrum Disorders (ASD)
    Sarvalingam, Parameswaran
    Vajravelu, Ashok
    Selvam, Janani
    Bin Ponniran, Asmarashid
    Zaki, Wan Suhaimizan Bin Wan
    Kathambari, P.
    BRAIN-BROAD RESEARCH IN ARTIFICIAL INTELLIGENCE AND NEUROSCIENCE, 2025, 16 (01) : 286 - 305
  • [46] POLYPHONE DISAMBIGUATION AND ACCENT PREDICTION USING PRE-TRAINED LANGUAGE MODELS IN JAPANESE TTS FRONT-END
    Hida, Rem
    Hamada, Masaki
    Kamada, Chie
    Tsunoo, Emiru
    Sekiya, Toshiyuki
    Kumakura, Toshiyuki
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7132 - 7136
  • [47] ST-BERT: CROSS-MODAL LANGUAGE MODEL PRE-TRAINING FOR END-TO-END SPOKEN LANGUAGE UNDERSTANDING
    Kim, Minjeong
    Kim, Gyuwan
    Lee, Sang-Woo
    Ha, Jung-Woo
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7478 - 7482
  • [48] On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex
    Zhuo, Terry Yue
    Li, Zhuang
    Huang, Yujin
    Shiri, Fatemeh
    Wang, Weiqing
    Haffari, Gholamreza
    Li, Yuan-Fang
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1090 - 1102
  • [49] Integration of WFST Language Model in Pre-trained Korean E2E ASR Model
    Oh, Junseok
    Cho, Eunsoo
    Kim, Ji-Hwan
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2024, 18 (06): : 1693 - 1706
  • [50] Model-Driven Deep-Learning for End-to-End Optimization in Fiber-Terahertz Communication Systems
    Li, Zhongya
    Wang, Chengxi
    Jia, Junlian
    Huang, Ouhan
    Dong, Boyu
    Li, Guoqiang
    Xing, Sizhe
    Zhou, Yingjun
    Shi, Jianyang
    Li, Ziwei
    Shen, Chao
    Zou, Peng
    Zhao, Yiheng
    Hu, Fangchen
    Chi, Nan
    Zhang, Junwen
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2025, 43 (07) : 3099 - 3117