Causality in requirements artifacts: prevalence, detection, and impact

被引:6
|
作者
Frattini, Julian [1 ]
Fischbach, Jannik [2 ,3 ]
Mendez, Daniel [1 ,4 ]
Unterkalmsteiner, Michael [1 ]
Vogelsang, Andreas [3 ]
Wnuk, Krzysztof [1 ]
机构
[1] Blekinge Inst Technol, Karlskrona, Sweden
[2] Qualicen GmbH, Munich, Germany
[3] Univ Cologne, Cologne, Germany
[4] Fortiss GmbH, Munich, Germany
关键词
Causality; Multi-case study; Requirements engineering; Natural language processing; AGREEMENT; QUALITY; KAPPA; CAUSATION;
D O I
10.1007/s00766-022-00371-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Causal relations in natural language (NL) requirements convey strong, semantic information. Automatically extracting such causal information enables multiple use cases, such as test case generation, but it also requires to reliably detect causal relations in the first place. Currently, this is still a cumbersome task as causality in NL requirements is still barely understood and, thus, barely detectable. In our empirically informed research, we aim at better understanding the notion of causality and supporting the automatic extraction of causal relations in NL requirements. In a first case study, we investigate 14.983 sentences from 53 requirements documents to understand the extent and form in which causality occurs. Second, we present and evaluate a tool-supported approach, called CiRA, for causality detection. We conclude with a second case study where we demonstrate the applicability of our tool and investigate the impact of causality on NL requirements. The first case study shows that causality constitutes around 28 % of all NL requirements sentences. We then demonstrate that our detection tool achieves a macro-F-1 score of 82 % on real-world data and that it outperforms related approaches with an average gain of 11.06 % in macro-Recall and 11.43 % in macro-Precision. Finally, our second case study corroborates the positive correlations of causality with features of NL requirements. The results strengthen our confidence in the eligibility of causal relations for downstream reuse, while our tool and publicly available data constitute a first step in the ongoing endeavors of utilizing causality in RE and beyond.
引用
收藏
页码:49 / 74
页数:26
相关论文
共 50 条
  • [41] A Second Look at the Impact of Passive Voice Requirements on Domain Modeling: Bayesian Reanalysis of an Experiment
    Frattini, Julian
    Fucci, Davide
    Torkar, Richard
    Mendez, Daniel
    PROCEEDINGS OF THE 2024 IEEE/ACM INTERNATIONAL WORKSHOP ON METHODOLOGICAL ISSUES WITH EMPIRICAL STUDIES IN SOFTWARE ENGINEERING, WSESE 2024, 2024, : 27 - 33
  • [42] Impact of a novel multilayer imager on metal artifacts in MV-CBCT
    Harris, T. C.
    Jacobson, M.
    Myronakis, M.
    Lehmann, M.
    Huber, P.
    Morf, D.
    Ozoemelam, I
    Hu, Y. H.
    Ferguson, D.
    Fueglistaller, R.
    Arroyo, P. Corral
    Berbeco, R., I
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (14)
  • [43] Resettable Encoded Vector Clock for Causality Analysis With an Application to Dynamic Race Detection
    Pozzetti, Tommaso
    Kshemkalyani, Ajay D.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (04) : 772 - 785
  • [44] Impact of blue economy sectors using causality, correlation and panel data models
    Martinez-Vazquez, Rosa Maria
    Milan-Garcia, Juan
    Manso, Jose Ramos Pires
    Valenciano, Jaime De Pablo
    FRONTIERS IN MARINE SCIENCE, 2023, 10
  • [45] Causality detection based on information-theoretic approaches in time series analysis
    Hlavackova-Schindler, Katerina
    Palus, Milan
    Vejmelka, Martin
    Bhattacharya, Joydeep
    PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2007, 441 (01): : 1 - 46
  • [46] Non-parametric causality detection: An application to social media and financial data
    Tsapeli, Fani
    Musolesi, Mirco
    Tino, Peter
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2017, 483 : 139 - 155
  • [47] Automatic artifacts and arousals detection in whole-night sleep EEG recordings
    't Wallant, Dorothee Coppieters
    Muto, Vincenzo
    Gaggioni, Giulia
    Jaspar, Mathieu
    Chellappa, Sarah L.
    Meyer, Christelle
    Vandewalle, Gilles
    Maquet, Pierre
    Phillips, Christophe
    JOURNAL OF NEUROSCIENCE METHODS, 2016, 258 : 124 - 133
  • [48] The impact of domain knowledge on the effectiveness of requirements engineering activities
    Niknafs, Ali
    Berry, Daniel
    EMPIRICAL SOFTWARE ENGINEERING, 2017, 22 (01) : 80 - 133
  • [49] Characterizing the Impact of Requirements Volatility on Systems Engineering Effort
    Pena, Mauricio
    Valerdi, Ricardo
    SYSTEMS ENGINEERING, 2015, 18 (01) : 59 - 70
  • [50] Industrial requirements classification for redundancy and inconsistency detection in SEMIOS
    Mezghani, Manel
    Kang, Juyeon
    Sedes, Florence
    2018 IEEE 26TH INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE 2018), 2018, : 297 - 303