Development and Practical Application of Methods for Detecting Similar Supercomputer Jobs

被引：0

作者：

Shaikhislamov, Denis ^{[1
]}

Voevodin, Vadim ^{[1
,2
]}

机构：

[1] Lomonosov Moscow State Univ, Res Comp Ctr, Moscow, Russia

[2] Moscow Ctr Fundamental & Appl Math, Moscow, Russia

来源：

PARALLEL COMPUTATIONAL TECHNOLOGIES | 2021年 / 1437卷

基金：

俄罗斯基础研究基金会;

关键词：

Supercomputers; High-performance computing; Similar applications; Data analysis; Software package detection;

D O I：

10.1007/978-3-030-81691-9_2

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

In the field of supercomputer technologies, the task of detecting similar applications is poorly developed, despite frequently popping up in the solution of many practically important problems. One of them is the detection of software packages and libraries used in supercomputer applications. In this paper, we address this task. It is worth noting that the task can be partially solved with the help of specialized system software. However, there are many situations when such tools are not enough. We discuss two mutually complementary approaches: the static one, involving the analysis of data obtained by parsing executable files, and the dynamic one, which relies on the analysis of monitoring data during the execution of an application. The analysis of real-life data from the Lomonosov-2 supercomputer confirms that the methods suggested in this paper ensure high accuracy and can be handy in detecting new cases of package usage that can not be identified by other available methods.

引用

页码：18 / 30

页数：13

共 15 条

[1] User Environment Tracking and Problem Detection with XALT [J].

Agrawal, Kapil ;

Fahey, Mark R. ;

McLay, Robert ;

James, Doug .

2014 1ST INTERNATIONAL WORKSHOP ON HPC USER SUPPORT TOOLS (HUST), 2014, :32-40

[2] LASCAD : Language-agnostic software categorization and similar application detection [J].

Altarawy, Doaa ;

Shahin, Hossameldin ;

Mohammed, Ayat ;

Meng, Na .

JOURNAL OF SYSTEMS AND SOFTWARE, 2018, 142 :21-34

[3]

Berndt DJ, 1994, P 3 INT C KNOWL DISC, P359

[4]

Hou L., 2019, P 2019 12 INT C IMAG, DOI [DOI 10.1109/CISPBMEI48845.2019.8966048, 10.1109/CISP-BMEI48845.2019.8966048, DOI 10.1109/CISP-BMEI48845.2019.8966048]

[5]

Keogh E.J., 2001, 1 SIAM INT C DATA MI, V1, P1, DOI [DOI 10.1137/1.9781611972719.1, 10.1137/1.9781611972719.1]

[6]

Pei W., 2016, ARXIV

[7] GROMACS 4.5: a high-throughput and highly parallel open source molecular simulation toolkit [J].

Pronk, Sander ;

Pall, Szilard ;

Schulz, Roland ;

Larsson, Per ;

Bjelkmar, Par ;

Apostolov, Rossen ;

Shirts, Michael R. ;

Smith, Jeremy C. ;

Kasson, Peter M. ;

van der Spoel, David ;

Hess, Berk ;

Lindahl, Erik .

BIOINFORMATICS, 2013, 29 (07) :845-854

[8]

Le Q, 2014, PR MACH LEARN RES, V32, P1188

[9] Toward accurate dynamic time warping in linear time and space [J].

Salvadora, Stan ;

Chan, Philip .

INTELLIGENT DATA ANALYSIS, 2007, 11 (05) :561-580

[10]

Shaikhislamov D., 2020, CCIS, V1263, P46, DOI [10.1007/978-3-030-55326-5, DOI 10.1007/978-3-030-55326-5]

← 1 2 →