Parallel tiled QR factorization for multicore architectures

被引:80
作者
Buttari, Alfredo [1 ]
Langou, Julien [2 ]
Kurzak, Jakub [1 ]
Dongarra, Jack [1 ,3 ,4 ]
机构
[1] Univ Tennessee, Dept Elect Engn & Comp Sci, Knoxville, TN 37916 USA
[2] Univ Colorado, Dept Math Sci, Denver, CO 80202 USA
[3] Oak Ridge Natl Lab, Div Math & Comp Sci, Oak Ridge, TN USA
[4] Univ Manchester, Manchester, Lancs, England
关键词
multicore; linear algebra; QR factorization;
D O I
10.1002/cpe.1301
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
As multicore systems continue to gain ground in the high-performance computing world, linear algebra algorithms have to he reformulated or new algorithms have to he developed in order to take advantage of the architectural features on these new processors. Fine-grain parallelism becomes a major requirement and introduces the necessity of loose synchronization in the parallel execution of an operation. This paper presents an algorithm for the QR factorization where the operations can he represented as a sequence of small tasks that operate on square blocks of data (referred to as 'tiles'). These tasks can he dynamically scheduled for execution based on the dependencies among them and on the availability of computational resources. This may result in an out-of-order execution of the tasks that will completely hide the presence of intrinsically sequential tasks in the factorization. performance comparisons are presented with the LAPACK algorithm for QR factorization where parallelism can be exploited only at the level of the BLAS operations and with vendor implementations. Copyright (E) 2008 John Wiley & Sons, Ltd.
引用
收藏
页码:1573 / 1590
页数:18
相关论文
共 25 条
  • [1] Anderson E, 1999, LAPACK USERS GUIDE
  • [2] [Anonymous], PARA 95
  • [3] A PARALLEL ALGORITHM FOR THE REDUCTION OF A NONSYMMETRIC MATRIX TO BLOCK UPPER-HESSENBERG FORM
    BERRY, MW
    DONGARRA, JJ
    KIM, YB
    [J]. PARALLEL COMPUTING, 1995, 21 (08) : 1189 - 1211
  • [4] Buttari A, 2007, LECT NOTES COMPUT SC, V4699, P1
  • [5] Chan E, 2007, SPAA'07: PROCEEDINGS OF THE NINETEENTH ANNUAL SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES, P116
  • [6] ScaLAPACK: A portable linear algebra library for distributed memory computers - Design issues and performance
    Choi, J
    Demmel, J
    Dhillon, I
    Dongarra, J
    Ostrouchov, S
    Petitet, A
    Stanley, K
    Walker, D
    Whaley, RC
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 1996, 97 (1-2) : 1 - 15
  • [7] OpenMP: An industry standard API for shared-memory programming
    Dagum, L
    Menon, R
    [J]. IEEE COMPUTATIONAL SCIENCE & ENGINEERING, 1998, 5 (01): : 46 - 55
  • [8] SPECIAL ISSUE - MPI - A MESSAGE-PASSING INTERFACE STANDARD
    DONGARRA, J
    WALKER, D
    LUSK, E
    KNIGHTEN, B
    SNIR, M
    GEIST, A
    OTTO, S
    HEMPEL, R
    LUSK, E
    GROPP, W
    COWNIE, J
    SKJELLUM, T
    CLARKE, L
    LITTLEFIELD, R
    SEARS, M
    HUSSLEDERMAN, S
    ANDERSON, E
    BERRYMAN, S
    FEENEY, J
    FRYE, D
    HART, L
    HO, A
    KOHL, J
    MADAMS, P
    MOSHER, C
    PIERCE, P
    SCHIKUTA, E
    VOIGT, RG
    BABB, R
    BJORNSON, R
    FERNANDO, V
    GLENDINNING, I
    HAUPT, T
    HO, CTH
    KRAUSS, S
    MAINWARING, A
    NESSETT, D
    RANKA, S
    SINGH, A
    WEEKS, D
    BARON, J
    DOSS, N
    FINEBERG, S
    GREENBERG, A
    HELLER, D
    HOWELL, G
    LEARY, B
    MCBRYAN, O
    PACHECO, P
    RIGSBEE, P
    [J]. INTERNATIONAL JOURNAL OF SUPERCOMPUTER APPLICATIONS AND HIGH PERFORMANCE COMPUTING, 1994, 8 (3-4): : 165 - &
  • [9] Applying recursion to serial and parallel QR factorization leads to better performance
    Elmroth, E
    Gustavson, FG
    [J]. IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2000, 44 (04) : 605 - 624
  • [10] Golub G. H., 1996, MATRIX COMPUTATIONS