Metamorphic Testing for Adobe Data Analytics Software

被引：28

作者：

Jarman, Darryl C. ^{[1
]}

Zhou, Zhi Quan ^{[2
]}

Chen, Tsong Yueh ^{[3
]}

机构：

[1] Adobe Syst Inc, 3900 Adobe Way, Lehi, UT 84043 USA

[2] Univ Wollongong, Sch Comp & IT, Wollongong, NSW 2522, Australia

[3] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Hawthorn, Vic 3122, Australia

来源：

2017 IEEE/ACM 2ND INTERNATIONAL WORKSHOP ON METAMORPHIC TESTING (MET 2017) | 2017年

关键词：

Time series analysis; anomaly detection; metamorphic testing; metamorphic relation; geometric transformation; verification and validation;

D O I：

10.1109/MET.2017.1

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

It is challenging to test data analytics software because a test oracle might not be available. This study reports our experience of applying metamorphic testing to Adobe's data analytics software that is used for anomaly detection in a set of time series data. We make use of geometric transformations to build metamorphic relations and generate simple time series data as the source test cases. The results of this study show that metamorphic testing is highly effective for both verification and validation purposes. An investigation of the issues detected during metamorphic testing revealed three bugs in the software under test.

引用

页码：21 / 27

页数：7

共 10 条

[1]

[Anonymous], 2015, Wiley Series in Probability and Statistics

[2] The Oracle Problem in Software Testing: A Survey [J].

Barr, Earl T. ;

Harman, Mark ;

McMinn, Phil ;

Shahbaz, Muzammil ;

Yoo, Shin .

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2015, 41 (05) :507-525

[3] Metamorphic Testing for Cybersecurity [J].

Chen, Tsong Yueh ;

Kuo, Fei-Ching ;

Ma, Wenjuan ;

Susilo, Willy ;

Towey, Dave ;

Voas, Jeffrey ;

Zhou, Zhi Quan .

COMPUTER, 2016, 49 (06) :48-55

[4]

Chen Tsong Yueh, 1998, TECHNICAL REPORT HKU

[5] Fault-based testing without the need of oracles [J].

Chen, TY ;

Tse, TH ;

Zhou, ZQ .

INFORMATION AND SOFTWARE TECHNOLOGY, 2003, 45 (01) :1-9

[6]

Hyndman RJ, 2008, SPRINGER SER STAT, P3

[7] Research Directions for Engineering Big Data Analytics Software [J].

Otero, Carlos E. ;

Peter, Adrian .

IEEE INTELLIGENT SYSTEMS, 2015, 30 (01) :13-19

[8] A Survey on Metamorphic Testing [J].

Segura, Sergio ;

Fraser, Gordon ;

Sanchez, Ana B. ;

Ruiz-Cortes, Antonio .

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2016, 42 (09) :805-824

[9] Metamorphic Testing for Software Quality Assessment: A Study of Search Engines [J].

Zhou, Zhi Quan ;

Xiang, Shaowen ;

Chen, Tsong Yueh .

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2016, 42 (03) :264-284

[10] Automated functional testing of online search services [J].

Zhou, Zhi Quan ;

Zhang, ShuJia ;

Hagenbuchner, Markus ;

Tse, T. H. ;

Kuo, Fei-Ching ;

Chen, T. Y. .

SOFTWARE TESTING VERIFICATION & RELIABILITY, 2012, 22 (04) :221-243

← 1 →