HIGHER-ORDER SELF-CONSISTENT FIELD: EFFICIENT DECOUPLING ALGORITHMS FOR FINDING THE BEST RANK-ONE APPROXIMATION OF HIGHER-ORDER TENSORS

被引:0
作者
Xiao, Chuanfu [1 ,2 ]
Li, Zeyu [3 ]
Yang, Chao [1 ,2 ]
机构
[1] Peking Univ, Sch Math Sci, Beijing 100871, Peoples R China
[2] PKU Changsha Inst Comp & Digital Econ, Changsha 410205, Hunan, Peoples R China
[3] Peking Univ, Yuanpei Coll, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
rank-one approximation; decoupling algorithm; self-consistent-field iteration; eigenvector-dependent nonlinear eigenvalue problem; parallel scalability; SINGULAR-VALUE DECOMPOSITION; PRINCIPAL COMPONENT ANALYSIS; POWER METHOD; MATRIX; SVD;
D O I
10.1137/24M1642688
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Best rank-one approximation is one of the most fundamental tasks in tensor computation. In order to fully exploit modern multicore parallel computers, it is necessary to develop decoupling algorithms for computing the best rank-one approximation of higher-order tensors at large scales. In this paper, we first build a bridge between the rank-one approximation of tensors and the eigenvector-dependent nonlinear eigenvalue problem, and then develop an efficient decoupling algorithm, namely, the higher-order self-consistent field (HOSCF) algorithm, inspired by the famous self-consistent field iteration frequently used in computational chemistry. The convergence theory of the HOSCF algorithm and an estimation of the convergence speed are further presented. In addition, we propose an improved HOSCF (iHOSCF) algorithm that incorporates the Rayleigh quotient iteration, which can significantly accelerate the convergence of HOSCF. Numerical experiments show that the proposed algorithms can efficiently converge to the best rank-one approximation of both synthetic and real-world tensors and can scale with high parallel scalability on a modern parallel computer.
引用
收藏
页码:1518 / 1539
页数:22
相关论文
共 57 条
[1]   A Parallel Jacobi-Embedded Gauss-Seidel Method [J].
Ahmadi, Afshin ;
Manganiello, Felice ;
Khademi, Amin ;
Smith, Melissa C. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (06) :1452-1464
[2]  
[Anonymous], 2019, Tensor Toolbox for MATLAB Version 3.1
[3]   VARIATIONAL CHARACTERIZATION OF MONOTONE NONLINEAR EIGENVECTOR PROBLEMS AND GEOMETRY OF SELF-CONSISTENT FIELD ITERATION [J].
Bai, Zhaojun ;
Lu, Ding .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2024, 45 (01) :84-111
[4]   Review on multiway analysis in chemistry - 2000-2005 [J].
Bro, Rasmus .
CRITICAL REVIEWS IN ANALYTICAL CHEMISTRY, 2006, 36 (3-4) :279-293
[5]   ON AN EIGENVECTOR-DEPENDENT NONLINEAR EIGENVALUE PROBLEM [J].
Cai, Yunfeng ;
Zhang, Lei-Hong ;
Bai, Zhaojun ;
Li, Ren-Cang .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2018, 39 (03) :1360-1382
[6]  
Chandra R., 2001, Parallel Programming in Openmp
[7]  
Cichocki A, 2016, FOUND TRENDS MACH LE, V9, P431, DOI [10.1561/2200000067, 10.1561/2200000059]
[8]   Tensor Networks for Dimensionality Reduction and Large-Scale Optimization Part 1 Low-Rank Tensor Decompositions [J].
Cichocki, Andrzej ;
Lee, Namgil ;
Oseledets, Ivan ;
Anh-Huy Phan ;
Zhao, Qibin ;
Mandic, Danilo P. .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2016, 9 (4-5) :I-+
[9]   On the best rank-1 and rank-(R1,R2,...,RN) approximation of higher-order tensors [J].
De Lathauwer, L ;
De Moor, B ;
Vandewalle, J .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2000, 21 (04) :1324-1342
[10]   Tensor-Based Modulation for Unsourced Massive Random Access [J].
Decurninge, Alexis ;
Land, Ingmar ;
Guillaud, Maxime .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (03) :552-556