Performance Analysis of Fractional Learning Algorithms

被引:9
作者
Wahab, Abdul [1 ]
Khan, Shujaat [2 ]
Naseem, Imran [3 ,4 ]
Ye, Jong Chul [5 ]
机构
[1] Nazarbayev Univ, Sch Sci & Humanities, Dept Math, Nur Sultan 010000, Kazakhstan
[2] Korea Adv Inst Sci & Technol, Dept Bio & Brain Engn, Daejeon 34141, South Korea
[3] Univ Western Australia, Sch Elect Elect & Comp Engn, Crawley, Western 6009, Australia
[4] PM Karachi Inst Econ & Technol, Coll Engn, Korangi Creek 75190, Pakistan
[5] Korea Adv Inst Sci & Technol, Kim Jaechul Grad Sch AI, Daejeon 34141, South Korea
关键词
Signal processing algorithms; Convergence; Prediction algorithms; Performance analysis; Costs; Australia; Iterative methods; Least mean squares; fractional least mean squares; fractional derivatives; gradient descent; MEAN-SQUARE ALGORITHM; PARAMETER-ESTIMATION; ADAPTIVE STRATEGY; GRADIENT DESCENT; NEURAL-NETWORKS; STEP-SIZE; ORDER; LMS; SYSTEMS; IDENTIFICATION;
D O I
10.1109/TSP.2022.3215735
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Fractional learning algorithms are trending in signal processing and adaptive filtering recently. However, it is unclear whether their proclaimed superiority over conventional algorithms is well-grounded or is a myth as their performance has never been extensively analyzed. In this article, a rigorous analysis of fractional variants of the least mean squares and steepest descent algorithms is performed. Some critical schematic kinks in fractional learning algorithms are identified. Their origins and consequences on the performance of the learning algorithms are discussed and swift ready-witted remedies are proposed. Apposite numerical experiments are conducted to discuss the convergence and efficiency of the fractional learning algorithms in stochastic environments. The analysis substantiates that the fractional learning algorithms have no advantage over the conventional least mean squares algorithm.
引用
收藏
页码:5164 / 5177
页数:14
相关论文
共 61 条
[1]  
Al-Refai M, 2012, ELECTRON J QUAL THEO, P1
[2]  
[Anonymous], 2006, THEORY APPL FRACTION, DOI DOI 10.1016/S0304-0208(06)80001-0
[3]  
[Anonymous], 2001, Adaptive Digital Filters
[4]  
[Anonymous], 1985, Adaptive Signal Processing
[5]   A new adaptive strategy to improve online secondary path modeling in active noise control systems using fractional signal processing approach [J].
Aslam, Muhammad Saeed ;
Raja, Muhammad Asif Zahoor .
SIGNAL PROCESSING, 2015, 107 :433-443
[6]   A nonlinear analytical model for the quantized LMS algorithm - The arbitrary step size case [J].
Bermudez, JCM ;
Bershad, NJ .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1996, 44 (05) :1175-1183
[7]   Comments on "Fractional LMS algorithm" [J].
Bershad, Neil J. ;
Wen, Fuxi ;
So, Hing Cheung .
SIGNAL PROCESSING, 2017, 133 :219-226
[8]   Design of momentum fractional LMS for Hammerstein nonlinear system identification with application to electrically stimulated muscle model [J].
Chaudhary, Naveed Ishtiaq ;
Zubair, Syed ;
Aslam, Muhammad Saeed ;
Raja, Muhammad Asif Zahoor ;
Machado, J. A. Tenreiro .
EUROPEAN PHYSICAL JOURNAL PLUS, 2019, 134 (08)
[9]   Normalized fractional adaptive methods for nonlinear control autoregressive systems [J].
Chaudhary, Naveed Ishtiaq ;
Khan, Zeshan Aslam ;
Zubair, Syed ;
Raja, Muhammad Asif Zahoor ;
Dedovic, Nebojsa .
APPLIED MATHEMATICAL MODELLING, 2019, 66 :457-471
[10]   A new computing approach for power signal modeling using fractional adaptive algorithms [J].
Chaudhary, Naveed Ishtiaq ;
Zubair, Syed ;
Raja, Muhammad Asif Zahoor .
ISA TRANSACTIONS, 2017, 68 :189-202