Faulty Requirements Made Valuable: On the Role of Data Quality in Deep Learning

被引:27
作者
Challa, Harshitha [1 ]
Niu, Nan [1 ]
Johnson, Reese [2 ]
机构
[1] Univ Cincinnati, Dept Elect Engn & Comp Syst, Cincinnati, OH 45221 USA
[2] Metropolitan Sewer Dist Greater Cincinnati, Cincinnati, OH USA
来源
2020 IEEE SEVENTH INTERNATIONAL WORKSHOP ON ARTIFICIAL INTELLIGENCE FOR REQUIREMENTS ENGINEERING (AIRE 2020) | 2020年
基金
美国国家科学基金会;
关键词
Data quality; stationarity; recurrent neural network; metamorphic testing; smart sewer systems; SYSTEMS; TRACEABILITY;
D O I
10.1109/AIRE51212.2020.00016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large collections of data help evolve deep learning into the state-of-the-art in solving many artificial intelligence problems. However, the requirements engineering (RE) community has yet to adapt to such sweeping changes caused exclusively by data. One reason is that the traditional requirements quality like unambiguity becomes less applicable to data, and so do requirements fault detection techniques like inspections. In this paper, we view deep learning as a class of machines whose effects must be evaluated with direct consideration of inherent data quality attributes: accuracy, consistency, currentness, etc. We substantiate this view by altering stationarity of the multivariate time-series data, and by further analyzing how the stationarity changes affect the behavior of a recurrent neural network in the context of predicting combined sewer overflow. Our work sheds light on the active role RE plays in deep learning.
引用
收藏
页码:61 / 69
页数:9
相关论文
共 49 条
[1]   Investigation of individual factors impacting the effectiveness of requirements inspections: a replicated experiment [J].
Albayrak, Ozlem ;
Carver, Jeffrey C. .
EMPIRICAL SOFTWARE ENGINEERING, 2014, 19 (01) :241-266
[2]   A Novel Approach to Tracing Safety Requirements and State-Based Design Models [J].
Alenazi, Mounifah ;
Niu, Nan ;
Savolainen, Juha .
2020 ACM/IEEE 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2020), 2020, :848-860
[3]   SysML Modeling Mistakes and Their Impacts on Requirements [J].
Alenazi, Mounifah ;
Niu, Nan ;
Savolainen, Juha .
2019 IEEE 27TH INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE WORKSHOPS (REW 2019), 2019, :14-23
[4]  
[Anonymous], 2006, Pattern recognition and machine learning
[5]  
[Anonymous], 1975, The Mythical Man-Month
[6]   Development of a human error taxonomy for software requirements: A systematic literature review [J].
Anu, Vaibhav ;
Hu, Wenhua ;
Carver, Jeffrey C. ;
Walia, Gursimran S. ;
Bradshaw, Gary .
INFORMATION AND SOFTWARE TECHNOLOGY, 2018, 103 :112-124
[7]   Usefulness of a Human Error Identification Tool for Requirements Inspection: An Experience Report [J].
Anu, Vaibhav ;
Walia, Gursimran ;
Bradshaw, Gary ;
Hu, Wenhua ;
Carver, Jeffrey C. .
REQUIREMENTS ENGINEERING: FOUNDATION FOR SOFTWARE QUALITY, REFSQ 2017, 2017, 10153 :370-377
[8]   SOFTWARE ERRORS AND COMPLEXITY - AN EMPIRICAL-INVESTIGATION [J].
BASILI, VR ;
PERRICONE, BT .
COMMUNICATIONS OF THE ACM, 1984, 27 (01) :42-52
[9]  
BOEHM BW, 1976, IEEE T COMPUT, V25, P1226, DOI 10.1109/TC.1976.1674590
[10]   The Impact of Educational Background on the Effectiveness of Requirements Inspections: An Empirical Study [J].
Carver, Jeffrey C. ;
Nagappan, Nachiappan ;
Page, Alan .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2008, 34 (06) :800-812