On greedy randomized average block Kaczmarz method for solving large linear systems

被引:33
作者
Miao, Cun-Qiang [1 ]
Wu, Wen-Ting [2 ,3 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha 410083, Peoples R China
[2] Beijing Inst Technol, Sch Math & Stat, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, MIIT Key Lab Math Theory & Computat Informat Secu, Beijing 102488, Peoples R China
基金
中国国家自然科学基金;
关键词
System of linear equations; Average block; Kaczmarz method; Randomized iteration; Convergence property; EXTENDED KACZMARZ; ITERATIVE METHODS; GAUSS-SEIDEL; CONVERGENCE; CONSISTENT; ALGORITHM;
D O I
10.1016/j.cam.2022.114372
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Inspired by the greedy randomized Kaczmarz method, we propose a probability criterion which can capture subvectors of the residual whose norms are relatively large. According to this probability criterion we select a submatrix randomly from the coefficient matrix, then average the projections of the current iteration vector onto each individual row of this chosen submatrix, constructing the greedy randomized average block Kaczmarz method for solving the consistent system of linear equations, which can be implemented in a distributed environment. When the size of each block is one, the probability criterion in the greedy randomized average block Kaczmarz method is a generalization of that in the greedy randomized Kaczmarz method. The greedy randomized Kaczmarz method is also a special case of the greedy randomized average block Kaczmarz method. Two kinds of extrapolated stepsizes for the greedy randomized average block Kaczmarz method are analyzed. The experimental results show the advantage of the greedy randomized average block Kaczmarz method over the greedy randomized Kaczmarz method and several existing randomized block Kaczmarz methods. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 29 条
[1]   ON GREEDY RANDOMIZED AUGMENTED KACZMARZ METHOD FOR SOLVING LARGE SPARSE INCONSISTENT LINEAR SYSTEMS [J].
Bai, Zhong-Zhi ;
Wu, Wen-Ting .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2021, 43 (06) :A3892-A3911
[2]   On partially randomized extended Kaczmarz method for solving large sparse overdetermined inconsistent linear systems [J].
Bai, Zhong-Zhi ;
Wu, Wen-Ting .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2019, 578 :225-250
[3]   On greedy randomized coordinate descent methods for solving large linear least-squares problems [J].
Bai, Zhong-Zhi ;
Wu, Wen-Ting .
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2019, 26 (04)
[4]   On convergence rate of the randomized Kaczmarz method [J].
Bai, Zhong-Zhi ;
Wu, Wen-Ting .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2018, 553 :252-269
[5]   On relaxed greedy randomized Kaczmarz methods for solving large sparse linear systems [J].
Bai, Zhong-Zhi ;
Wu, Wen-Ting .
APPLIED MATHEMATICS LETTERS, 2018, 83 :21-26
[6]   ON GREEDY RANDOMIZED KACZMARZ METHOD FOR SOLVING LARGE SPARSE LINEAR SYSTEMS [J].
Bai, Zhong-Zhi ;
Wu, Wen-Ting .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2018, 40 (01) :A592-A606
[7]   On the Meany inequality with applications to convergence analysis of several row-action iteration methods [J].
Bai, Zhong-Zhi ;
Liu, Xin-Guo .
NUMERISCHE MATHEMATIK, 2013, 124 (02) :215-236
[8]  
Bai ZZ., 2021, Matrix Analysis and Computations
[9]   A SAMPLING KACZMARZ-MOTZKIN ALGORITHM FOR LINEAR FEASIBILITY [J].
De Loera, Jesus A. ;
Haddock, Jamie ;
Needell, Deanna .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2017, 39 (05) :S66-S87
[10]   RANDOMIZED EXTENDED AVERAGE BLOCK KACZMARZ FOR SOLVING LEAST SQUARES [J].
Du, Kui ;
Si, Wu-Tao ;
Sun, Xiao-Hui .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2020, 42 (06) :A3541-A3559