Automatic Operator Performance Tuning in a Machine Learning System on Edge

被引:0
|
作者
Xu, Peng [1 ]
Chang, Xinyu [1 ]
Zhao, Jianxin [1 ]
Liu, Chi Harold [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
来源
2022 IEEE 28TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, ICPADS | 2022年
基金
中国国家自然科学基金;
关键词
optimization; automatic tuning; convolution; machine learning system;
D O I
10.1109/ICPADS56603.2022.00109
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the current large scale deployment of machine learning technologies, such as those on cloud servers and edge and IoT hardwares, machine learning systems have been widely prevalence. Practical requirement has driven their performance increase in both academia and industry. However, the application requirement varies greatly across different applications, and directly using off-the-shelf systems might not be sufficient in many cases. In this work, we first propose to implement a series of techniques to optimize performance of convolution operation, one of the most important operations, in constructing deep learning networks. Besides, we also propose to apply the automated empirical optimisation of software approach to improve the performance of operators in machine learning system, most notably across various hardware platforms. Evaluation compared to existing libraries on different hardware devices has proved the efficiency of our proposed method.
引用
收藏
页码:802 / 809
页数:8
相关论文
共 50 条
  • [31] A Query-Level Distributed Database Tuning System with Machine Learning
    Fang, Xiang
    Zou, Yi
    Fang, Yange
    Tang, Zhen
    Li, Hui
    Wang, Wei
    2022 IEEE 13TH INTERNATIONAL CONFERENCE ON JOINT CLOUD COMPUTING (JCC 2022), 2022, : 29 - 36
  • [32] Machine learning PV system performance analyser
    Rodrigues, Sandy
    Ramos, Helena Geirinhas
    Morgado-Dias, Fernando
    PROGRESS IN PHOTOVOLTAICS, 2018, 26 (08): : 675 - 687
  • [33] Assessment of Performance for Cloud-Native Machine Learning on Edge Devices
    Clapa, Konrad
    Grudzien, Krzysztof
    Sierszen, Artur
    DIGITAL INTERACTION AND MACHINE INTELLIGENCE, MIDI 2023, 2024, 1076 : 95 - 105
  • [34] EdgeInsight: Characterizing and Modeling the Performance of Machine Learning Inference on the Edge and Cloud
    Ross, Philipp
    Luckow, Andre
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 1897 - 1906
  • [35] Automatic Tuning of Rule-Based Evolutionary Machine Learning via Problem Structure Identification
    Franco, Maria A.
    Krasnogor, Natalio
    Bacardit, Jaume
    IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2020, 15 (03) : 28 - 46
  • [36] Workshop: IWAPT Automatic Performance Tuning
    Komatsu, Kazuhiko
    2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021, 2021, : 750 - 751
  • [37] ON THE PERFORMANCE OF COMPUTER AUTOMATIC TUNING AT THE UNILAC
    DAHL, L
    KLABUNDE, J
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 1985, 32 (05) : 2153 - 2155
  • [38] Machine learning enables completely automatic tuning of a quantum device faster than human experts
    Moon, H.
    Lennon, D. T.
    Kirkpatrick, J.
    van Esbroeck, N. M.
    Camenzind, L. C.
    Yu, Liuqi
    Vigneau, F.
    Zumbuehl, D. M.
    Briggs, G. A. D.
    Osborne, M. A.
    Sejdinovic, D.
    Laird, E. A.
    Ares, N.
    NATURE COMMUNICATIONS, 2020, 11 (01)
  • [39] Machine learning enables completely automatic tuning of a quantum device faster than human experts
    H. Moon
    D. T. Lennon
    J. Kirkpatrick
    N. M. van Esbroeck
    L. C. Camenzind
    Liuqi Yu
    F. Vigneau
    D. M. Zumbühl
    G. A. D. Briggs
    M. A. Osborne
    D. Sejdinovic
    E. A. Laird
    N. Ares
    Nature Communications, 11
  • [40] A Transactional Memory with Automatic Performance Tuning
    Wang, Qingping
    Kulkarni, Sameer
    Cavazos, John
    Spear, Michael
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2012, 8 (04)