A Transfer Learning Framework for High-Accurate Cross-Workload Design Space Exploration of CPU

被引:2
作者
Wang, Duo [1 ,2 ]
Yan, Mingyu [1 ,2 ]
Teng, Yihan [1 ,2 ]
Han, Dengke [1 ,2 ]
Dang, Haoran [1 ,2 ]
Ye, Xiaochun [1 ,2 ]
Fan, Dongrui [1 ,2 ]
机构
[1] Chinese Acad Sci, SKLP, Inst Comp Technol, Beijing, Peoples R China
[2] UNiv Chinese Acad Sci, Beijing, Peoples R China
来源
2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD | 2023年
基金
中国国家自然科学基金;
关键词
Design Space Exploration; Cross-workload; Prediction Model; Transfer Learning; CPU Microarchitecture; PERFORMANCE;
D O I
10.1109/ICCAD57390.2023.10323840
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
To perform cross-workload design space exploration of CPU, previous works implicitly transfer knowledge from several existing source workloads and try to make predictions on the target one. However, they do not fully explore the transferability across workloads and their single basic prediction models limit the prediction accuracy. In this paper, an open-source Transfer learning Ensemble Design Space Exploration framework (TrEnDSE) is proposed to perform cross-workload performance predictions. The black-box transferability between workloads is quantitatively dissected and explicitly utilized as sample weights for training. Moreover, an ensemble bagging learning model and an uncertainty-driven iterative optimization method are proposed to perform accurate and robust prediction, with these sample weights leveraged. Experiments on SPEC CPU 2017 demonstrate that TrEnDSE can reduce cycle per instruction prediction error by 54% and power prediction error by 34% compared with the state-of-the-art work.
引用
收藏
页数:9
相关论文
共 14 条
  • [1] MoDSE: A High-Accurate Multiobjective Design Space Exploration Framework for CPU Microarchitectures
    Wang, Duo
    Yan, Mingyu
    Teng, Yihan
    Han, Dengke
    Liu, Xin
    Li, Wenming
    Ye, Xiaochun
    Fan, Dongrui
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (05) : 1525 - 1537
  • [2] A High-accurate Multi-objective Exploration Framework for Design Space of CPU
    Wang, Duo
    Yan, Mingyu
    Liu, Xin
    Zou, Mo
    Liu, Tianyu
    Li, Wenming
    Ye, Xiaochun
    Fan, Dongrui
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [3] A High-accurate Multi-objective Ensemble Exploration Framework for Design Space of CPU Microarchitecture
    Wang, Duo
    Yan, Mingyu
    Teng, Yihan
    Han, Dengke
    Ye, Xiaochun
    Fan, Dongrui
    PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2023, GLSVLSI 2023, 2023, : 379 - 383
  • [4] Transfer Learning for Design-Space Exploration with High-Level Synthesis
    Kwon, Jihye
    Carloni, Luca P.
    PROCEEDINGS OF THE 2020 ACM/IEEE 2ND WORKSHOP ON MACHINE LEARNING FOR CAD (MLCAD '20), 2020, : 163 - 168
  • [5] Machine learning based fast and accurate High Level Synthesis design space exploration: From graph to synthesis
    Goswami, Pingakshya
    Schaefer, Benjamin Carrion
    Bhatia, Dinesh
    INTEGRATION-THE VLSI JOURNAL, 2023, 88 : 116 - 124
  • [6] Design space exploration of neural network accelerator based on transfer learning
    Wu Y.
    Zhi T.
    Song X.
    Li X.
    High Technology Letters, 2023, 29 (04) : 416 - 426
  • [7] Fast and Inexpensive High-Level Synthesis Design Space Exploration: Machine Learning to the Rescue
    Rashid, Md Imtiaz
    Schafer, Benjamin Carrion
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (11) : 3939 - 3950
  • [8] A Fast Design Space Exploration Framework for the Deep Learning Accelerators: Work-in-Progress
    Colucci, Alessio
    Marchisio, Alberto
    Bussolino, Beatrice
    Mrazek, Voitech
    Martina, Maurizio
    Masera, Guido
    Shafique, Muhammad
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON HARDWARE/SOFTWARE CODESIGN AND SYSTEM SYNTHESIS (CODES+ISSS), 2019, : 34 - 36
  • [9] A Design-Space Exploration Framework for Application-Specific Machine Learning Targeting Reconfigurable Computing
    Mahmood, Safdar
    Huebner, Michael
    Reichenbach, Marc
    APPLIED RECONFIGURABLE COMPUTING. ARCHITECTURES, TOOLS, AND APPLICATIONS, ARC 2023, 2023, 14251 : 371 - 374
  • [10] Learning from the Past: Efficient High-level Synthesis Design Space Exploration for FPGAs
    Wang, Zi
    Schafer, Benjamin Carrion
    ACM TRANSACTIONS ON DESIGN AUTOMATION OF ELECTRONIC SYSTEMS, 2022, 27 (04)