Leveraging Mixed Precision in Exponential Time Integration Methods

被引:0
作者
Balos, Cody J. [1 ]
Roberts, Steven [1 ]
Gardner, David J. [1 ]
机构
[1] Lawrence Livermore Natl Lab, Ctr Appl Sci Comp, 7000 East Ave, Livermore, CA 94550 USA
来源
2023 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE, HPEC | 2023年
关键词
differential equations; mixed precision; high-performance computing; STIFF SYSTEMS; IMPLEMENTATION; PERFORMANCE; IMPLICIT;
D O I
10.1109/HPEC58863.2023.10363489
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The machine learning explosion has created a prominent trend in modern computer hardware towards low precision floating-point operations. In response, there have been growing efforts to use low and mixed precision in general scientific computing. One important area that has received limited exploration is time integration methods, which are used for solving differential equations that are ubiquitous in science and engineering applications. In this work, we develop two new approaches for leveraging mixed precision in exponential time integration methods. The first approach is based on a reformulation of the exponential Rosenbrock-Euler method allowing for low precision computations in matrix exponentials independent of the particular algorithm for matrix exponentiation. The second approach is based on an inexact and incomplete Arnoldi procedure in Krylov approximation methods for computing matrix exponentials and is agnostic to the chosen integration method. We show that both approaches improve accuracy compared to using purely low precision and offer better efficiency than using only double precision when solving an advection-diffusion-reaction partial differential equation.
引用
收藏
页数:8
相关论文
共 41 条
  • [1] A survey of numerical linear algebra methods utilizing mixed-precision arithmetic
    Abdelfattah, Ahmad
    Anzt, Hartwig
    Boman, Erik G.
    Carson, Erin
    Cojean, Terry
    Dongarra, Jack
    Fox, Alyson
    Gates, Mark
    Higham, Nicholas J.
    Li, Xiaoye S.
    Loe, Jennifer
    Luszczek, Piotr
    Pranesh, Srikara
    Rajamanickam, Siva
    Ribizel, Tobias
    Smith, Barry F.
    Swirydowicz, Kasia
    Thomas, Stephen
    Tomov, Stanimire
    Tsai, Yaohung M.
    Yang, Ulrike Meier
    [J]. INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2021, 35 (04) : 344 - 369
  • [2] Accelerating Geostatistical Modeling and Prediction With Mixed-Precision Computations: A High-Productivity Approach With PaRSEC
    Abdulah, Sameh
    Cao, Qinglei
    Pei, Yu
    Bosilca, George
    Dongarra, Jack
    Genton, Marc G.
    Keyes, David E.
    Ltaief, Hatem
    Sun, Ying
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (04) : 964 - 976
  • [3] COMPUTING THE ACTION OF THE MATRIX EXPONENTIAL, WITH AN APPLICATION TO EXPONENTIAL INTEGRATORS
    Al-Mohy, Awad H.
    Higham, Nicholas J.
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2011, 33 (02) : 488 - 511
  • [4] Accelerating scientific computations with mixed precision algorithms
    Baboulin, Marc
    Buttari, Alfredo
    Dongarra, Jack
    Kurzak, Jakub
    Langou, Julie
    Langou, Julien
    Luszczek, Piotr
    Tomov, Stanimire
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 2009, 180 (12) : 2526 - 2533
  • [5] Inexact matrix-vector products in Krylov methods for solving linear systems:: A relaxation strategy
    Bouras, A
    Frayssé, V
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2005, 26 (03) : 660 - 678
  • [6] Performance Evaluation of Mixed-Precision Runge-Kutta Methods
    Burnett, Ben
    Gottlieb, Sigal
    Grant, Zachary J.
    Heryudono, Alfa
    [J]. 2021 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2021,
  • [7] Implementation of exponential Rosenbrock-type integrators
    Caliari, Marco
    Ostermann, Alexander
    [J]. APPLIED NUMERICAL MATHEMATICS, 2009, 59 (3-4) : 568 - 581
  • [8] Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimization
    Chen, Weihan
    Wang, Peisong
    Cheng, Jian
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5330 - 5339
  • [9] Mixed-precision explicit stabilized Runge-Kutta methods for single- and multi-scale differential equations
    Croci, Matteo
    Souza, Giacomo Rosilho de
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2022, 464
  • [10] The University of Florida Sparse Matrix Collection
    Davis, Timothy A.
    Hu, Yifan
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2011, 38 (01):