Developing Accurate Slurm Simulator

被引:4
作者
Simakov, Nikolay A. [1 ]
DeLeon, Robert L. [1 ]
Lin, Yuqing [1 ]
Hoffmann, Phillip S. [1 ]
Mathias, William R. [1 ]
机构
[1] SUNY Buffalo, Ctr Computat Res, Buffalo, NY 14260 USA
来源
PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2022 | 2022年
基金
美国国家科学基金会;
关键词
HPC; Scheduling; Workload; Simulation; Slurm;
D O I
10.1145/3491418.3535178
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A new Slurm simulator compatible with the latest Slurm version has been produced. It was constructed by systematically transforming the Slurm code step by step to maintain the proper scheduler output realization while speeding up simulation time. To test this simulator, a container-based Virtual Cluster was generated which fully mimicked a production HPC cluster. As for all Slurm simulators, the realization is a stochastic process dependent on the computational hardware. Under favorable conditions the simulator is able to approximate the actual Slurm scheduling realization. The simulation fidelity is sufficient to use the simulator for its main function, that is, to test Slurm parameter configurations without having to experiment on full production systems.
引用
收藏
页数:4
相关论文
共 9 条
[1]  
Eleliemy A, 2021, Arxiv, DOI arXiv:2103.05809
[2]  
Jokanovic A, 2018, PROCEEDINGS OF 2018 IEEE/ACM PERFORMANCE MODELING, BENCHMARKING AND SIMULATION OF HIGH PERFORMANCE COMPUTER SYSTEMS (PMBS 2018), P72, DOI [10.1109/PMBS.2018.8641556, 10.1109/PMBS.2018.00012]
[3]   Nonparametric multivariate rank tests and their unbiasedness [J].
Jureckova, Jana ;
Kalina, Jan .
BERNOULLI, 2012, 18 (01) :229-251
[4]  
Martinasso Maxime, 2018, SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. Proceedings, P320, DOI 10.1109/SC.2018.00028
[5]  
Simakov N.A., 2018, PEARC '18, P1, DOI [10.1145/3219104.3219111, DOI 10.1145/3219104.3219111]
[6]   A Slurm Simulator: Implementation and Parametric Analysis [J].
Simakov, Nikolay A. ;
Innus, Martins D. ;
Jones, Matthew D. ;
DeLeon, Robert L. ;
White, Joseph P. ;
Gallo, Steven M. ;
Patra, Abani K. ;
Furlani, Thomas R. .
HIGH PERFORMANCE COMPUTING SYSTEMS: PERFORMANCE MODELING, BENCHMARKING, AND SIMULATION (PMBS 2017), 2018, 10724 :197-217
[7]  
Tanash Mohammed, 2021, ADVCOMP Int Conf Adv Eng Comput Appl Sci, V2021, P20
[8]   Mental health in relation to changes in sleep, exercise, alcohol and diet during the COVID-19 pandemic: examination of four UK cohort studies [J].
Villadsen, Aase ;
Patalay, Praveetha ;
Bann, David .
PSYCHOLOGICAL MEDICINE, 2023, 53 (07) :2748-2757
[9]  
Wang Hao, 2021, ADV AERODYNAM, V3, P1