Fast and Accurate Workload Characterization Using Locality Sensitive Hashing

被引:0
|
作者
Islam, Mohammad Shahedul [1 ]
Gibson, Matt [1 ]
Muzahid, Abdullah [1 ]
机构
[1] Univ Texas San Antonio, Comp Sci, San Antonio, TX 78249 USA
来源
2015 IEEE 17TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2015 IEEE 7TH INTERNATIONAL SYMPOSIUM ON CYBERSPACE SAFETY AND SECURITY, AND 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS) | 2015年
关键词
Application characterization; data center; locality sensitive hashing;
D O I
10.1109/HPCC-CSS-ICESS.2015.249
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Embedded applications are increasingly offloading their computations to a cloud data center. Determining an incoming application's sensitivity toward various shared resources is a major challenge. To this end, previous research attempts to characterize an incoming application's sensitivity toward interference on various resources (Source of Interference or SoI, for short) of a cloud system. Due to time constraints, the application's sensitivity is profiled in detail for only a small number of SoI, and the sensitivities for the remaining SoI are approximated by capitalizing on knowledge about some of the applications (i.e. training set) currently running in the system. A key drawback of previous approaches is that they have attempted to minimize the total error of the estimated sensitivities; however, various SoI do not behave the same as each other. For example, a 10% error in the estimate of SoI A may dramatically effect the QoS of an application whereas a 10% error in the estimate of SoI B may have a marginal effect. In this paper, we present a new method for workload characterization that considers these important issues. First, we compute an acceptable error for each SoI based on its effect on QoS, and our goal is to characterize an application so as to maximize the number of SoI that satisfy this acceptable error. Then we present a new technique for workload characterization based on Locality Sensitive Hashing (LSH). Our approach performs better than a state-of-the-art technique in terms of error rate (1.33 times better).
引用
收藏
页码:1192 / 1201
页数:10
相关论文
共 50 条
  • [21] Fast Distributed kNN Graph Construction Using Auto-tuned Locality-sensitive Hashing
    Eiras-Franco, Carlos
    Martinez-Rego, David
    Kanthan, Leslie
    Pineiro, Cesar
    Bahamonde, Antonio
    Guijarro-Berdinas, Bertha
    Alonso-Betanzos, Amparo
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2020, 11 (06)
  • [22] Compressing Locality Sensitive Hashing Tables
    Santoyo, Francisco
    Chavez, Edgar
    Tellez, Eric S.
    2013 MEXICAN INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE (ENC 2013), 2013, : 41 - 46
  • [23] Fast distributed video deduplication via locality-sensitive hashing with similarity ranking
    Li, Yeguang
    Hu, Liang
    Xia, Ke
    Luo, Jie
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2019, 2019 (1)
  • [24] A fast online learning algorithm of radial basis function network with locality sensitive hashing
    Ali S.H.A.
    Fukase K.
    Ozawa S.
    Evolving Systems, 2016, 7 (3) : 173 - 186
  • [25] Fast distributed video deduplication via locality-sensitive hashing with similarity ranking
    Yeguang Li
    Liang Hu
    Ke Xia
    Jie Luo
    EURASIP Journal on Image and Video Processing, 2019
  • [26] EFFICIENT MANIFOLD LEARNING FOR SPEECH RECOGNITION USING LOCALITY SENSITIVE HASHING
    Tomar, Vikrant Singh
    Rose, Richard C.
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 6995 - 6999
  • [27] Deduplication of Scholarly Documents using Locality Sensitive Hashing and Word Embeddings
    Gyawali, Bikash
    Anastasiou, Lucas
    Knoth, Petr
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 901 - 910
  • [28] A Locality Sensitive Hashing Technique for Categorical Data
    Lee, Kyung Mi
    Lee, Keon Myung
    INDUSTRIAL INSTRUMENTATION AND CONTROL SYSTEMS, PTS 1-4, 2013, 241-244 : 3159 - 3164
  • [29] Using Locality Sensitive Hashing to Improve the KNN Algorithm in the MapReduce Framework
    Bagui, Sikha
    Mondal, Arup Kumar
    Bagui, Subhash
    ACMSE '18: PROCEEDINGS OF THE ACMSE 2018 CONFERENCE, 2018,
  • [30] Ultrafast Genomic Database Search using Layered Locality Sensitive Hashing
    Chakraborty, Angana
    Bandyopadhyay, Sanghamitra
    PROCEEDINGS OF 2018 FIFTH INTERNATIONAL CONFERENCE ON EMERGING APPLICATIONS OF INFORMATION TECHNOLOGY (EAIT), 2018,