Testing of big data analytics systems by benchmark

被引:1
|
作者
Chen, Mingang [1 ]
Chen, Wenjie [1 ]
Cai, Lizhi [1 ]
机构
[1] Shanghai Dev Ctr Comp Software Technol, Shanghai Key Lab Comp Software Testing & Evaluati, Shanghai, Peoples R China
来源
2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW) | 2018年
关键词
testing; big data; benchmark; TPC-DS; TPCx-BigBench;
D O I
10.1109/ICSTW.2018.00054
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the rapid development of big data technologies and applications, various big data analytics systems have been released by open source communities and industry. So testing and evaluating the overall performance of these big data analytics systems has become an important research topic. The paper analyzes in detail the challenges of testing big data analytics systems and proposes the method and strategies for the testing. Furthermore, the paper presents two cases of testing big data analytics systems by benchmark.
引用
收藏
页码:231 / 238
页数:8
相关论文
共 50 条
  • [1] Data Analytics Algorithm Benchmark on Distributed Systems
    Hamid, Mohd Hakim Abdul
    Abu, Nur Azman
    Mohamad, Siti Nurul Mahfuzah
    Idris, Ariff
    Zakaria, Zahriladha
    Sulaiman, Zuraidah
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON APPLIED SCIENCE AND TECHNOLOGY (ICAST'18), 2018, 2016
  • [2] Big Data Analytics for Health Systems
    Yadav, Vikash
    Verma, Monika
    Kaushik, Vandana Dixit
    2015 INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND INTERNET OF THINGS (ICGCIOT), 2015, : 253 - 258
  • [3] Big Data Analytics in Healthcare Systems
    Wang, Lidong
    Alexander, Cheryl Ann
    INTERNATIONAL JOURNAL OF MATHEMATICAL ENGINEERING AND MANAGEMENT SCIENCES, 2019, 4 (01) : 17 - 26
  • [4] A Reliability Benchmark for Big Data Systems on JointCloud
    Zheng, Yingying
    Xu, Lijie
    Wang, Wei
    Zhou, Wei
    Ding, Ying
    2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2017, : 306 - 310
  • [5] Data-Less Big Data Analytics (Towards Intelligent Data Analytics Systems)
    Triantafillou, Peter
    2018 IEEE 34TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2018, : 1666 - 1667
  • [6] Tutorial on Benchmarking Big Data Analytics Systems
    Ivanov, Todor
    Singhal, Rekha
    ICPE'20: COMPANION OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, 2020, : 50 - 53
  • [7] Big data analytics in electricity distribution systems
    Stoyanov, St.
    Kakanakov, N.
    2017 40TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2017, : 205 - 208
  • [8] Big Data Analytics in Power Distribution Systems
    Yu, Nanpeng
    Shah, Sunil
    Johnson, Raymond
    Sherick, Robert
    Hong, Mingguo
    Loparo, Kenneth
    2015 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2015,
  • [9] Big Data Analytics and Intelligent Transportation Systems
    Montoya-Torres, Jairo R.
    Moreno, Sebastian
    Guerrero, William J.
    Mejia, Gonzalo
    IFAC PAPERSONLINE, 2021, 54 (02): : 216 - 220
  • [10] Big Data Analytics for Personalized Recommendation Systems
    Leung, Carson K.
    Kajal, Abhishek
    Won, Yeyoung
    Choi, Justin M. C.
    IEEE 17TH INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP / IEEE 17TH INT CONF ON PERVAS INTELLIGENCE AND COMP / IEEE 5TH INT CONF ON CLOUD AND BIG DATA COMP / IEEE 4TH CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2019, : 1060 - 1065