Faulty Requirements Made Valuable: On the Role of Data Quality in Deep Learning

被引:27
作者
Challa, Harshitha [1 ]
Niu, Nan [1 ]
Johnson, Reese [2 ]
机构
[1] Univ Cincinnati, Dept Elect Engn & Comp Syst, Cincinnati, OH 45221 USA
[2] Metropolitan Sewer Dist Greater Cincinnati, Cincinnati, OH USA
来源
2020 IEEE SEVENTH INTERNATIONAL WORKSHOP ON ARTIFICIAL INTELLIGENCE FOR REQUIREMENTS ENGINEERING (AIRE 2020) | 2020年
基金
美国国家科学基金会;
关键词
Data quality; stationarity; recurrent neural network; metamorphic testing; smart sewer systems; SYSTEMS; TRACEABILITY;
D O I
10.1109/AIRE51212.2020.00016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large collections of data help evolve deep learning into the state-of-the-art in solving many artificial intelligence problems. However, the requirements engineering (RE) community has yet to adapt to such sweeping changes caused exclusively by data. One reason is that the traditional requirements quality like unambiguity becomes less applicable to data, and so do requirements fault detection techniques like inspections. In this paper, we view deep learning as a class of machines whose effects must be evaluated with direct consideration of inherent data quality attributes: accuracy, consistency, currentness, etc. We substantiate this view by altering stationarity of the multivariate time-series data, and by further analyzing how the stationarity changes affect the behavior of a recurrent neural network in the context of predicting combined sewer overflow. Our work sheds light on the active role RE plays in deep learning.
引用
收藏
页码:61 / 69
页数:9
相关论文
共 49 条
[21]   Improving agile requirements: the Quality User Story framework and tool [J].
Lucassen, Garm ;
Dalpiaz, Fabiano ;
van der Werf, Jan Martijn E. M. ;
Brinkkemper, Sjaak .
REQUIREMENTS ENGINEERING, 2016, 21 (03) :383-403
[22]  
Lucassen G, 2015, INT REQUIR ENG CONF, P126, DOI 10.1109/RE.2015.7320415
[23]  
Lutz Robyn R, 1993, 1993 P IEEE INT S RE, P126
[24]   Supporting requirements to code traceability through refactoring [J].
Mahmoud, Anas ;
Niu, Nan .
REQUIREMENTS ENGINEERING, 2014, 19 (03) :309-329
[25]  
Murphy C., 2008, P 20 INT C SOFTW ENG, P867, DOI [10.7916/D8XK8PFD, DOI 10.7916/D8XK8PFD]
[26]   Using soft systems methodology to improve requirements practices: an exploratory case study [J].
Niu, N. ;
Lopez, A. Y. ;
Cheng, J-R C. .
IET SOFTWARE, 2011, 5 (06) :487-495
[27]   Requirements Socio-Technical Graphs for Managing Practitioners' Traceability Questions [J].
Niu, Nan ;
Wang, Wentao ;
Gupta, Arushi ;
Assarandarban, Mona ;
Xu, Li Da ;
Savolainen, Juha ;
Cheng, Jing-Ru C. .
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2018, 5 (04) :1152-1162
[28]   Requirements Engineering and Continuous Deployment [J].
Niu, Nan ;
Brinkkemper, Sjaak ;
Franch, Xavier ;
Partanen, Jari ;
Savolainen, Juha .
IEEE SOFTWARE, 2018, 35 (02) :86-90
[29]   Gray Links in the Use of Requirements Traceability [J].
Niu, Nan ;
Wang, Wentao ;
Gupta, Arushi .
FSE'16: PROCEEDINGS OF THE 2016 24TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON FOUNDATIONS OF SOFTWARE ENGINEERING, 2016, :384-395
[30]   A Systems Approach to Product Line Requirements Reuse [J].
Niu, Nan ;
Savolainen, Juha ;
Niu, Zhendong ;
Jin, Mingzhou ;
Cheng, Jing-Ru C. .
IEEE SYSTEMS JOURNAL, 2014, 8 (03) :827-836