Automatic Tuning of MPI Runtime Parameter Settings by Using Machine Learning

被引：5

作者：

Pellegrini, Simone ^{[1
]}

Fahringer, Thomas ^{[1
]}

Jordan, Herbert ^{[1
]}

Moritsch, Hans ^{[1
]}

机构：

[1] Univ Innsbruck, Distributed & Parallel Syst Grp, Technikerstr 21A, A-6020 Innsbruck, Austria

来源：

PROCEEDINGS OF THE 2010 COMPUTING FRONTIERS CONFERENCE (CF 2010) | 2010年

关键词：

MPI runtime parameters; tuning; machine learning;

D O I：

10.1145/1787275.1787310

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

MPI implementations provide several hundred runtime parameters that can be tuned for performance improvement. The ideal parameter setting does not only depend on the target multiprocessor architecture but also on the application, its problem and communicator size. This paper presents ATune, an automatic performance tuning tool that uses machine learning techniques to determine the program-specific optimal settings for a subset of the Open MPI's runtime parameters. ATune learns the behaviour of a target system by means of a training phase where several MPI benchmarks and MPI applications are run on a target architecture for varying problem and communicator sizes. For new input programs, only one run is required in order for ATune to deliver a prediction of the optimal runtime parameters values. Experiments based on the NAS Parallel Benchmarks performed on a cluster of SMP machines are shown that demonstrate the effectiveness of ATune. For these experiments, ATune derives MPI runtime parameter settings that are on average within 4% of the maximum performance achievable on the target system resulting in a performance gain of up to 18% with respect to the default parameter setting.

引用

页码：115 / 116

页数：2