Application of a Transfer Learning Model Combining CNN and Self-Attention Mechanism in Wireless Signal Recognition

被引:0
作者
Wei, Wu [1 ]
Zhu, Chenqi [2 ]
Hu, Lifan [2 ]
Liu, Pengfei [2 ]
机构
[1] Nanjing Cowave Commun Technol Co Ltd, Nanjing 211135, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Coll Commun & Informat Engn, Nanjing 210003, Peoples R China
基金
中国国家自然科学基金;
关键词
convolutional neural network; self-attention; wireless signal recognition; low SNR; low sampling rate; SPECTRUM; NETWORKS;
D O I
10.3390/s25134202
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, we propose TransConvNet, a hybrid model combining Convolutional Neural Networks (CNNs), self-attention mechanisms, and transfer learning for wireless signal recognition under challenging conditions. The model effectively addresses challenges such as low signal-to-noise ratio (SNR), low sampling rates, and limited labeled data. The CNN module extracts local features and suppresses noise, while the self-attention mechanism within the Transformer encoder captures long-range dependencies in the signal. To enhance performance with limited data, we incorporate transfer learning by leveraging pre-trained models, ensuring faster convergence and improved generalization. Extensive experiments were conducted on a six-class wireless signal dataset, downsampled to 1 MSPS to simulate real-world constraints. The proposed TransConvNet achieved 92.1% accuracy, outperforming baseline models such as LSTM, CNN, and RNN across multiple evaluation metrics, including RMSE and R2. The model demonstrated strong robustness under varying SNR conditions and exhibited superior discriminative ability, as confirmed by Precision-Recall and ROC curves. These results validate the effectiveness and robustness of the TransConvNet model for wireless signal recognition, particularly in resource-constrained and noisy environments.
引用
收藏
页数:16
相关论文
共 46 条
[1]  
Agarwal N., 2021, Smart Innovations in Communication and Computational Sciences, P145, DOI 10.1007/978-981-15-5345-513
[2]   Advances on Spectrum Sensing for Cognitive Radio Networks: Theory and Applications [J].
Ali, Abdelmohsen ;
Hamouda, Walaa .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2017, 19 (02) :1277-1304
[3]   Transfer Learning for Human Activity Recognition Using Representational Analysis of Neural Networks [J].
An, Sizhe ;
Bhat, Ganapati ;
Gumussoy, Suat ;
Ogras, Umit .
ACM TRANSACTIONS ON COMPUTING FOR HEALTHCARE, 2023, 4 (01)
[4]   Adversarial Transfer Learning for Deep Learning Based Automatic Modulation Classification [J].
Bu, Ke ;
He, Yuan ;
Jing, Xiaojun ;
Han, Jindong .
IEEE SIGNAL PROCESSING LETTERS, 2020, 27 :880-884
[5]   Root mean square error (RMSE) or mean absolute error (MAE)? - Arguments against avoiding RMSE in the literature [J].
Chai, T. ;
Draxler, R. R. .
GEOSCIENTIFIC MODEL DEVELOPMENT, 2014, 7 (03) :1247-1250
[6]  
Davis J., 2006, IN, P233, DOI DOI 10.1145/1143844.1143874
[7]  
Dhekane SG, 2024, Arxiv, DOI arXiv:2401.10185
[8]  
Di Bucchianico A., 2008, Encyclopedia of statistics in quality and reliability, peqr173, DOI [10.1002/9780470061572.eqr173, DOI 10.1002/9780470061572.EQR173]
[9]   Towards low-complexity wireless technology classification across multiple environments [J].
Fontaine, Jaron ;
Fonseca, Erika ;
Shahid, Adnan ;
Kist, Maicon ;
DaSilva, Luiz A. ;
Moerman, Ingrid ;
De Poorter, Eli .
AD HOC NETWORKS, 2019, 91
[10]   The Real-World-Weight Cross-Entropy Loss Function: Modeling the Costs of Mislabeling [J].
Ho, Yaoshiang ;
Wookey, Samuel .
IEEE ACCESS, 2020, 8 :4806-4813