Removing Host Interventions from GPU Accelerated Neural Network

被引:0
|
作者
Yoo, Jeongjoon [1 ]
Oh, Kyongjoo [1 ]
Jun, Jaehee [1 ]
Cho, Hoonhee [1 ]
Kim, Kyeongmin [1 ]
机构
[1] Samsung Elect, Suwon, South Korea
来源
2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE | 2023年
关键词
OpenCL; GPU; Neural Network; Performance; Delegator; Host intervention;
D O I
10.1109/ICCE56470.2023.10043523
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we present a novel scheme removing host interventions from OpenCL execution in GPUaccelerated neural network. Our scheme must satisfy two folds; i) remove host interventions between CPU and GPU interactions, ii) use previous OpenCL kernels without modification. To do so, we propose a Delegator-based OpenCL execution method providing a good solution in such situation. Experimental result shows that our scheme reduces execution latency into 0.43.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] GPU-accelerated artificial neural network potential for molecular dynamics simulation
    Zhang, Meng
    Hibi, Koki
    Inoue, Junya
    COMPUTER PHYSICS COMMUNICATIONS, 2023, 285
  • [2] A GPU-accelerated cortical neural network model for visually guided robot navigation
    Beyeler, Michael
    Oros, Nicolas
    Dutt, Nikil
    Krichmar, Jeffrey L.
    NEURAL NETWORKS, 2015, 72 : 75 - 87
  • [3] Noise Removing from Web Pages Using Neural Network
    Htwe, Thanda
    Hla, Khin Haymar Saw
    2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 1, 2010, : 281 - 285
  • [4] GPU-accelerated differential dependency network analysis
    Speyer, Gil
    Rodriguez, Juan J.
    Bencomo, Tomas
    Kim, Seungchan
    2018 26TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2018), 2018, : 410 - 414
  • [5] SPEED-UP OF OBJECT DETECTION NEURAL NETWORK WITH GPU
    Fukagai, Takuya
    Maeda, Kyosuke
    Tanabe, Satoshi
    Shirahata, Koichi
    Tomita, Yasumoto
    Ike, Atsushi
    Nakagawa, Akira
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 301 - 305
  • [6] Redundant Network Traffic Elimination with GPU Accelerated Rabin Fingerprinting
    Sun, Jianhua
    Chen, Hao
    He, Ligang
    Tan, Huailiang
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2016, 27 (07) : 2130 - 2142
  • [7] Accelerating anomaly-based IDS using Neural Network on GPU
    Nguyen Thi Thanh Van
    Tran Ngoc Thinh
    2015 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND APPLICATIONS (ACOMP), 2015, : 67 - 74
  • [8] Forecasting large scale conditional volatility and covariance using neural network on GPU
    Xianggao Cai
    Guoming Lai
    Xiaola Lin
    The Journal of Supercomputing, 2013, 63 : 490 - 507
  • [9] QuanDA: GPU AcceleratedQuantitative Deep Neural Network Analysis
    Naseer, Mahum
    Hasan, Osman
    Shafique, Muhammad
    ACM TRANSACTIONS ON DESIGN AUTOMATION OF ELECTRONIC SYSTEMS, 2023, 28 (06)
  • [10] Forecasting large scale conditional volatility and covariance using neural network on GPU
    Cai, Xianggao
    Lai, Guoming
    Lin, Xiaola
    JOURNAL OF SUPERCOMPUTING, 2013, 63 (02) : 490 - 507