An adaptable parallel algorithm for the direct numerical simulation of incompressible turbulent flows using a Fourier spectral/hp element method and MPI virtual topologies

被引:19
作者
Bolls, A. [1 ]
Cantwell, C. D. [1 ]
Moxey, D. [1 ]
Serson, D. [1 ]
Sherwin, S. J. [1 ]
机构
[1] Imperial Coll London, Dept Aeronaut, South Kensington Campus, London, England
基金
英国工程与自然科学研究理事会;
关键词
Spectral/hp element method; High-order methods; Incompressible flows; MPI parallelisation; Virtual topologies;
D O I
10.1016/j.cpc.2016.04.011
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A hybrid parallelisation technique for distributed memory systems is investigated for a coupled Fourier-spectral/hp element discretisation of domains characterised by geometric homogeneity in one or more directions. The performance of the approach is mathematically modelled in terms of operation count and communication costs for identifying the most efficient parameter choices. The model is calibrated to target a specific hardware platform after which it is shown to accurately predict the performance in the hybrid regime. The method is applied to modelling turbulent flow using the incompressible Navier Stokes equations in an axisymmetric pipe and square channel. The hybrid method extends the practical limitations of the discretisation, allowing greater parallelism and reduced wall times. Performance is shown to continue to scale when both parallelisation strategies are used. (C) 2016 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
引用
收藏
页码:17 / 25
页数:9
相关论文
共 29 条
[1]  
Anderson E, 1999, LAPACK users' guide, V3rd
[2]   The Onset of Turbulence in Pipe Flow [J].
Avila, Kerstin ;
Moxey, David ;
de Lozar, Alberto ;
Avila, Marc ;
Barkley, Dwight ;
Hof, Bjorn .
SCIENCE, 2011, 333 (6039) :192-196
[3]   Convective instability and transient growth in flow over a backward-facing step [J].
Blackburn, H. M. ;
Barkley, D. ;
Sherwin, S. J. .
JOURNAL OF FLUID MECHANICS, 2008, 603 :271-304
[4]   Nektar plus plus : An open-source spectral/hp element framework [J].
Cantwell, C. D. ;
Moxey, D. ;
Comerford, A. ;
Bolis, A. ;
Rocco, G. ;
Mengaldo, G. ;
De Grazia, D. ;
Yakovlev, S. ;
Lombard, J. -E. ;
Ekelschot, D. ;
Jordi, B. ;
Xu, H. ;
Mohamied, Y. ;
Eskilsson, C. ;
Nelson, B. ;
Vos, P. ;
Biotto, C. ;
Kirby, R. M. ;
Sherwin, S. J. .
COMPUTER PHYSICS COMMUNICATIONS, 2015, 192 :205-219
[5]   From h to p Efficiently: Selecting the Optimal Spectral/hp Discretisation in Three Dimensions [J].
Cantwell, C. D. ;
Sherwin, S. J. ;
Kirby, R. M. ;
Kelly, P. H. J. .
MATHEMATICAL MODELLING OF NATURAL PHENOMENA, 2011, 6 (03) :84-96
[6]   From h to p efficiently: Strategy selection for operator evaluation on hexahedral and tetrahedral elements [J].
Cantwell, C. D. ;
Sherwin, S. J. ;
Kirby, R. M. ;
Kelly, P. H. J. .
COMPUTERS & FLUIDS, 2011, 43 (01) :23-28
[7]   Transient growth analysis of flow through a sudden expansion in a circular pipe [J].
Cantwell, C. D. ;
Barkley, D. ;
Blackburn, H. M. .
PHYSICS OF FLUIDS, 2010, 22 (03) :1-15
[8]   Parallel benchmarks of turbulence in complex geometries [J].
Crawford, CH ;
Evangelinos, C ;
Newman, D ;
Karniadakis, GE .
COMPUTERS & FLUIDS, 1996, 25 (07) :677-698
[9]  
Demmel J., 1993, ACTA NUMER, V2, P111, DOI [10.1017/S096249290000235X, DOI 10.1017/S096249290000235X]
[10]  
Evangelinos C., 1996, P 1996 ACM IEEE C SU