A flexible class of parallel matrix multiplication algorithms

被引:24
|
作者
Gunnels, J [1 ]
Lin, C [1 ]
Morrow, G [1 ]
van de Geijn, R [1 ]
机构
[1] Univ Texas, Dept Comp Sci, Austin, TX 78712 USA
关键词
D O I
10.1109/IPPS.1998.669898
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper explains why parallel implementation of matrix multiplication-a seemingly simple algorithm that can be expressed as one statement and three nested loops-is complex: Practical algorithms that use matrix multiplication tend to use matrices of disparate shapes, and the shape of the matrices can significantly impact the performance of matrix multiplication. We provide a class of algorithms that covers the spectrum of shapes encountered and demonstrate that good performance can be attained if the right algorithm is chosen. While the paper resolves a number of issues, it concludes with discussion of a number of directions yet to be pursued.
引用
收藏
页码:110 / 116
页数:7
相关论文
共 50 条
  • [1] Analysis of parallel matrix multiplication algorithms
    Liu, WL
    Gu, YL
    DCABES 2004, PROCEEDINGS, VOLS, 1 AND 2, 2004, : 354 - 357
  • [3] MATRIX VECTOR MULTIPLICATION - PARALLEL ALGORITHMS AND ARCHITECTURES
    CODENOTTI, B
    PUGLISI, C
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 1988, 16 (12) : 1057 - 1063
  • [4] Parallel matrix multiplication algorithms on hypercube multiprocessors
    Lee, PZ
    INTERNATIONAL JOURNAL OF HIGH SPEED COMPUTING, 1995, 7 (03): : 391 - 406
  • [5] Comparison of some parallel matrix multiplication algorithms
    Tasic, JF
    Zajc, M
    Kosir, A
    MELECON '96 - 8TH MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, PROCEEDINGS, VOLS I-III: INDUSTRIAL APPLICATIONS IN POWER SYSTEMS, COMPUTER SCIENCE AND TELECOMMUNICATIONS, 1996, : 155 - 158
  • [6] Parallel Transpose of Matrix Multiplication Based on the Tiling Algorithms
    Kim, Minwoo
    Jang, Yong J.
    Ro, Won W.
    2011 IEEE 54TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2011,
  • [7] Efficient parallel VLSI architecture for matrix multiplication like algorithms
    Lafage, Anne
    Jutand, Francis
    International Workshop on Algorithms and Parallel VLSI Architectures, 1991,
  • [8] Matrix Multiplication Algorithms
    Thabet, Khaled
    AL-Ghuribi, Sumaia
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2012, 12 (02): : 74 - 79
  • [9] Parallel Matrix Multiplication
    Tomikj, Nikola
    Gusev, Marjan
    2018 41ST INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2018, : 204 - 209
  • [10] Novel implementations of parallel matrix multiplication algorithms using optical buses
    Li, KQ
    Pan, Y
    Zheng, SQ
    INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-IV, PROCEEDINGS, 1998, : 1212 - 1220