Automatic Operator Performance Tuning in a Machine Learning System on Edge

被引:0
|
作者
Xu, Peng [1 ]
Chang, Xinyu [1 ]
Zhao, Jianxin [1 ]
Liu, Chi Harold [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
来源
2022 IEEE 28TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, ICPADS | 2022年
基金
中国国家自然科学基金;
关键词
optimization; automatic tuning; convolution; machine learning system;
D O I
10.1109/ICPADS56603.2022.00109
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the current large scale deployment of machine learning technologies, such as those on cloud servers and edge and IoT hardwares, machine learning systems have been widely prevalence. Practical requirement has driven their performance increase in both academia and industry. However, the application requirement varies greatly across different applications, and directly using off-the-shelf systems might not be sufficient in many cases. In this work, we first propose to implement a series of techniques to optimize performance of convolution operation, one of the most important operations, in constructing deep learning networks. Besides, we also propose to apply the automated empirical optimisation of software approach to improve the performance of operators in machine learning system, most notably across various hardware platforms. Evaluation compared to existing libraries on different hardware devices has proved the efficiency of our proposed method.
引用
收藏
页码:802 / 809
页数:8
相关论文
共 50 条
  • [1] Automatic Database Index Tuning Using Machine Learning
    Valavala, Mounicasri
    Alhamdani, Wasim
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT 2021), 2021, : 523 - 530
  • [2] Automatic Database Management System Tuning Through Large-scale Machine Learning
    Van Aken, Dana
    Pavlo, Andrew
    Gordon, Geoffrey J.
    Zhang, Bohan
    SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, : 1009 - 1024
  • [3] On combining system and machine learning performance tuning for distributed data stream applications
    Odysseos, Lambros
    Herodotou, Herodotos
    DISTRIBUTED AND PARALLEL DATABASES, 2023, 41 (03) : 411 - 438
  • [4] On combining system and machine learning performance tuning for distributed data stream applications
    Lambros Odysseos
    Herodotos Herodotou
    Distributed and Parallel Databases, 2023, 41 : 411 - 438
  • [5] Automatic Selection of Tuning Plugins in PTF Using Machine Learning
    Mijakovic, Robert
    Gerndt, Michael
    2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020), 2020, : 349 - 358
  • [6] Methodology: Automatic Database Index Tuning Using Machine Learning
    Valavala, Mounicasri
    Alhamdani, Wasim
    2021 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, SMART AND GREEN TECHNOLOGIES (ICISSGT 2021), 2021, : 109 - 113
  • [7] EAT-ML: Efficient Automatic Tuning for Machine Learning Models in Cyber Physical System
    Zhang, Hongli
    Huang, Shouming
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (14)
  • [8] Automatic Performance Tuning for the Virtualized Cluster System
    Weng, Chuliang
    Li, Minglu
    Wang, Zhigang
    Lu, Xinda
    2009 29TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, 2009, : 183 - 190
  • [9] A machine learning approach for automatic performance of a trumpet
    Bilitski, J
    ICCIMA 2005: Sixth International Conference on Computational Intelligence and Multimedia Applications, Proceedings, 2005, : 80 - 85
  • [10] On a Way Together - Database and Machine Learning for Performance Tuning
    Khosla, Cherry
    Saini, Baljit Singh
    2021 INTERNATIONAL CONFERENCE ON COMPUTING SCIENCES (ICCS 2021), 2021, : 123 - 128