Speech Semantic Communication Based on Swin Transformer

被引:2
作者
Zhou, Ziliang [1 ]
Zheng, Shilian [2 ]
Chen, Jie [1 ]
Zhao, Zhijin [1 ]
Yang, Xiaoniu [2 ]
机构
[1] Hangzhou Dianzi Univ, Coll Commun Engn, Hangzhou 310018, Peoples R China
[2] Natl Key Lab Electromagnet Space Secur, Innovat Studio Academician Yang, Jiaxing 314033, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantic communication; speech communication; deep learning; end-to-end communication; SYSTEMS;
D O I
10.1109/TCCN.2023.3345858
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Semantic communication is a novel communication paradigm which refers to the extraction and encoding of semantic information from the source, and the restoration of information from a semantic perspective at the receiver. In this paper, we propose an end-to-end speech semantic communication system based on Transformer, called DeepSC-TS. It focuses on reconstructing and integrating multi-level information from the transmitted semantic signal at the receiver, effectively eliminating semantic signal noise while preserving the original semantic information. Moreover, it does not increase the data load of the original signal during transmission. Simulation results demonstrate that our proposed DeepSC-TS exhibits outstanding performance in different channel environments and it performs better than an existing speech semantic communication system.
引用
收藏
页码:756 / 768
页数:13
相关论文
共 33 条
[21]   Performance measurement in blind audio source separation [J].
Vincent, Emmanuel ;
Gribonval, Remi ;
Févotte, Cedric .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2006, 14 (04) :1462-1469
[22]   Deep Learning Enabled Semantic Communications With Speech Recognition and Synthesis [J].
Weng, Zhenzi ;
Qin, Zhijin ;
Tao, Xiaoming ;
Pan, Chengkang ;
Liu, Guangyi ;
Li, Geoffrey Ye .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (09) :6227-6240
[23]   Semantic Communications for Speech Signals [J].
Weng, Zhenzi ;
Qin, Zhijin ;
Li, Geoffrey Ye .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
[24]   Semantic Communication Systems for Speech Transmission [J].
Weng, Zhenzi ;
Qin, Zhijin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (08) :2434-2444
[25]   Task-Oriented Multi-User Semantic Communications [J].
Xie, Huiqiang ;
Qin, Zhijin ;
Tao, Xiaoming ;
Letaief, Khaled B. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (09) :2584-2597
[26]   Task-Oriented Multi-User Semantic Communications for VQA [J].
Xie, Huiqiang ;
Qin, Zhijin ;
Li, Geoffrey Ye .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (03) :553-557
[27]   Deep Learning Enabled Semantic Communication Systems [J].
Xie, Huiqiang ;
Qin, Zhijin ;
Li, Geoffrey Ye ;
Juang, Biing-Hwang .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 :2663-2675
[28]   A Lite Distributed Semantic Communication System for Internet of Things [J].
Xie, Huiqiang ;
Qin, Zhijin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (01) :142-153
[29]  
Zhang GY, 2024, Arxiv, DOI arXiv:2209.07689
[30]   Context-Based Semantic Communication via Dynamic Programming [J].
Zhang, Yichi ;
Zhao, Haitao ;
Wei, Jibo ;
Zhang, Jiao ;
Flanagan, Mark F. ;
Xiong, Jun .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (03) :1453-1467