An Improved Initialization Method for Fast Learning in Long Short-Term Memory-Based Markovian Spectrum Prediction

被引:13
作者
Radhakrishnan, Niranjana [1 ]
Kandeepan, Sithamparanathan [1 ]
机构
[1] RMIT Univ, Sch Engn, Melbourne, Vic 3001, Australia
关键词
Predictive models; Hidden Markov models; Computational modeling; Training; Markov processes; Data models; Context modeling; Spectrum prediction; long short-term memory; initialization method; deep learning; neural networks; MANAGEMENT;
D O I
10.1109/TCCN.2020.3046330
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
The opportunistic sharing of frequency bands supported in the Dynamic Spectrum Access (DSA) paradigm resolves the spectrum scarcity issue in wireless communications. To this end, deep learning models such as Long Short-Term Memory (LSTM) are becoming a popular choice for predicting the spectrum for cognitive radio type applications. However, the computational complexity to train such models can be very high, and delays in performing spectrum prediction (even in the order of msec) can reduce spectrum utilization efficiency. Here, we propose a novel method to initialize LSTM to reduce the training time to a good extent based on prior (statistical) knowledge of the input data and hence minimize the delay in spectrum prediction. This article proposes the 'Kandeepan-Niranjana (K-N) initialization', a novel initialization methodology for an LSTM based system model. We consider the well-known Markov model based spectrum utilization data with prior knowledge of the model parameters, such as the transition probabilities, to explain our method. Our results show that initialization with the parameters we propose provides a significant improvement in the training convergence of the LSTM based model for spectrum prediction. We also observe fast training convergence when the proposed method is applied to a real spectrum dataset.
引用
收藏
页码:729 / 738
页数:10
相关论文
共 34 条
  • [11] Eltom H, 2015, 2015 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ICSPCS)
  • [12] Eltom H, 2016, IEEE INT CONF COMM, P669, DOI 10.1109/ICCW.2016.7503864
  • [13] Glorot X., 2010, Proceedings of the thirteenth international conference on artificial intelligence and statistics, P249, DOI DOI 10.1109/LGRS.2016.2565705
  • [14] Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
  • [15] Joneidi M., 2019, LARGE SCALE SPECTRUM
  • [16] Deep Learning-Based Channel Prediction in Realistic Vehicular Communications
    Joo, Jhihoon
    Park, Myung Chul
    Han, Dong Seog
    Pejovic, Veljko
    [J]. IEEE ACCESS, 2019, 7 : 27846 - 27858
  • [17] Online Spectrum Prediction With Adaptive Threshold Quantization
    Li, Haoyu
    Ding, Xiaojin
    Yang, Yiguang
    Xie, Zhuochen
    Zhang, Gengxin
    [J]. IEEE ACCESS, 2019, 7 : 174325 - 174334
  • [18] Primary user characterization for cognitive radio wireless networks using a neural system based on Deep Learning
    Lopez, Danilo
    Rivas, Edwin
    Gualdron, Oscar
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2019, 52 (01) : 169 - 195
  • [19] López-Benítez M, 2011, LECT NOTES COMPUT SC, V6827, P32, DOI 10.1007/978-3-642-23041-7_4
  • [20] A Survey of Resource Management Toward 5G Radio Access Networks
    Olwal, Thomas O.
    Djouani, Karim
    Kurien, Anish M.
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2016, 18 (03) : 1656 - 1686