Self-Supervised RF Signal Representation Learning for NextG Signal Classification With Deep Learning

被引:12
|
作者
Davaslioglu, Kemal [1 ,2 ]
Boztas, Serdar [1 ,2 ]
Ertem, Mehmet Can [1 ,2 ]
Sagduyu, Yalin E. [3 ]
Ayanoglu, Ender [4 ]
机构
[1] Univ Tech Serv Inc, Dept Appl Res, Greenbelt, MD 20770 USA
[2] Univ Tech Serv Inc, Engn Div, Greenbelt, MD 20770 USA
[3] Virginia Tech, Natl Secur Inst, Arlington, VA 22203 USA
[4] Univ Calif Irvine, Ctr Pervas Commun & Comp, Irvine, CA 92697 USA
关键词
Task analysis; Wireless communication; Modulation; Wireless sensor networks; Radio frequency; Signal to noise ratio; Semantics; Automatic modulation recognition; wireless signal classification; contrastive learning; deep learning; self-supervised learning; spectrum awareness;
D O I
10.1109/LWC.2022.3217292
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) finds rich applications in the wireless domain to improve spectrum awareness. Typically, DL models are either randomly initialized following a statistical distribution or pretrained on tasks from other domains in the form of transfer learning without accounting for the unique characteristics of wireless signals. Self-supervised learning (SSL) enables the learning of useful representations from Radio Frequency (RF) signals themselves even when only limited training data samples with labels are available. We present a self-supervised RF signal representation learning method and apply it to the automatic modulation recognition (AMR) task by specifically formulating a set of transformations to capture the wireless signal characteristics. We show that the sample efficiency (the number of labeled samples needed to achieve a certain performance) of AMR can be significantly increased (almost an order of magnitude) by learning signal representations with SSL. This translates to substantial time and cost savings. Furthermore, SSL increases the model accuracy compared to the state-of-the-art DL methods and maintains high accuracy when limited training data is available.
引用
收藏
页码:65 / 69
页数:5
相关论文
共 50 条
  • [21] Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
    Eldele, Emadeldeen
    Ragab, Mohamed
    Chen, Zhenghua
    Wu, Min
    Kwoh, Chee-Keong
    Li, Xiaoli
    Guan, Cuntai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15604 - 15618
  • [22] DeepSet SimCLR: Self-supervised deep sets for improved pathology representation learning
    Torpey, David
    Klein, Richard
    PATTERN RECOGNITION LETTERS, 2024, 186 : 64 - 70
  • [23] DimCL: Dimensional Contrastive Learning for Improving Self-Supervised Learning
    Nguyen, Thanh
    Pham, Trung Xuan
    Zhang, Chaoning
    Luu, Tung M.
    Vu, Thang
    Yoo, Chang D.
    IEEE ACCESS, 2023, 11 : 21534 - 21545
  • [24] CoSleep: A Multi-View Representation Learning Framework for Self-Supervised Learning of Sleep Stage Classification
    Ye, Jianan
    Xiao, Qinfeng
    Wang, Jing
    Zhang, Hongjun
    Deng, Jiaoxue
    Lin, Youfang
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 189 - 193
  • [25] Randomly shuffled convolution for self-supervised representation learning
    Oh, Youngjin
    Jeon, Minkyu
    Ko, Dohwan
    Kim, Hyunwoo J.
    INFORMATION SCIENCES, 2023, 623 : 206 - 219
  • [26] Self-supervised representation learning for surgical activity recognition
    Paysan, Daniel
    Haug, Luis
    Bajka, Michael
    Oelhafen, Markus
    Buhmann, Joachim M.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (11) : 2037 - 2044
  • [27] Heuristic Attention Representation Learning for Self-Supervised Pretraining
    Van Nhiem Tran
    Liu, Shen-Hsuan
    Li, Yung-Hui
    Wang, Jia-Ching
    SENSORS, 2022, 22 (14)
  • [28] Self-supervised contrastive representation learning for semantic segmentation
    Liu B.
    Cai H.
    Wang Y.
    Chen X.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2024, 51 (01): : 125 - 134
  • [29] Self-supervised representation learning for surgical activity recognition
    Daniel Paysan
    Luis Haug
    Michael Bajka
    Markus Oelhafen
    Joachim M. Buhmann
    International Journal of Computer Assisted Radiology and Surgery, 2021, 16 : 2037 - 2044
  • [30] Self-Supervised ECG Representation Learning for Emotion Recognition
    Sarkar, Pritam
    Etemad, Ali
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (03) : 1541 - 1554