Few-shot HPC application runtime prediction

被引:0
作者
Chen, Si [1 ]
Garcia De Gonzalo, Simon [2 ]
Wildani, Avani [1 ]
机构
[1] Emory Univ, Atlanta, GA 30322 USA
[2] Sandia Natl Labs, POB 5800, Albuquerque, NM 87185 USA
来源
2023 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING WORKSHOPS, CLUSTER WORKSHOPS | 2023年
关键词
Meta-Learning; HPC Performance analysis; simulation system;
D O I
10.1109/CLUSTERWorkshops61457.2023.00018
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Precise runtime prediction for HPC jobs is essential for streamlined hardware/software co-design, resource allocation, and assessing the impact of hardware alterations. Existing runtime prediction methods, however, are generally application and architecture-specific, hindering their broad applicability. In response, we propose a novel meta-learning and simulation-based model that accommodates a wide range of applications and architectures. This method efficiently addresses new runtime challenges using only a limited number of samples. As demonstrated by our experiments, with just ten training samples, this model attains an average MAPE of 19% on the SPEC CPU 2006 benchmarks.
引用
收藏
页码:46 / 47
页数:2
相关论文
共 50 条
[31]   Reinforcement Learning in Few-Shot Scenarios: A Survey [J].
Zhechao Wang ;
Qiming Fu ;
Jianping Chen ;
Yunzhe Wang ;
You Lu ;
Hongjie Wu .
Journal of Grid Computing, 2023, 21
[32]   Exploring sample relationship for few-shot classification [J].
Chen, Xingye ;
Wu, Wenxiao ;
Ma, Li ;
You, Xinge ;
Gao, Changxin ;
Sang, Nong ;
Shao, Yuanjie .
PATTERN RECOGNITION, 2025, 159
[33]   SW-Net: A novel few-shot learning approach for disease subtype prediction [J].
Ji, Yuhan ;
Liang, Yong ;
Yang, Ziyi ;
AI, Ning .
BIOCELL, 2023, 47 (03) :569-579
[34]   Few-Shot Object Detection: A Comprehensive Survey [J].
Koehler, Mona ;
Eisenbach, Markus ;
Gross, Horst-Michael .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) :11958-11978
[35]   Subspace Adaptation Prior for Few-Shot Learning [J].
Mike Huisman ;
Aske Plaat ;
Jan N. van Rijn .
Machine Learning, 2024, 113 :725-752
[36]   Few-shot Learning for Heterogeneous Information Networks [J].
Fang, Yang ;
Zhao, Xiang ;
Xiao, Weidong ;
De Rijke, Maarten .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (04)
[37]   Prototypical Siamese Networks for Few-shot Learning [J].
Wang, Junhua ;
Zhai, Yongping .
PROCEEDINGS OF 2020 IEEE 10TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2020), 2020, :178-181
[38]   Few-shot classification with Fork Attention Adapter [J].
Sun, Jieqi ;
Li, Jian .
PATTERN RECOGNITION, 2024, 156
[39]   Multidomain Graph Meta-Learning Network for Few-Shot Prediction in Industrial Processes [J].
Kong, Liyuan ;
Liu, Zhe ;
Yan, Feng ;
Yan, Duojin ;
Yang, Chunjie .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
[40]   Diversified Contrastive Learning For Few-Shot Classification [J].
Lu, Guangtong ;
Li, Fanzhang .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 :147-158