Causality in requirements artifacts: prevalence, detection, and impact

被引:6
|
作者
Frattini, Julian [1 ]
Fischbach, Jannik [2 ,3 ]
Mendez, Daniel [1 ,4 ]
Unterkalmsteiner, Michael [1 ]
Vogelsang, Andreas [3 ]
Wnuk, Krzysztof [1 ]
机构
[1] Blekinge Inst Technol, Karlskrona, Sweden
[2] Qualicen GmbH, Munich, Germany
[3] Univ Cologne, Cologne, Germany
[4] Fortiss GmbH, Munich, Germany
关键词
Causality; Multi-case study; Requirements engineering; Natural language processing; AGREEMENT; QUALITY; KAPPA; CAUSATION;
D O I
10.1007/s00766-022-00371-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Causal relations in natural language (NL) requirements convey strong, semantic information. Automatically extracting such causal information enables multiple use cases, such as test case generation, but it also requires to reliably detect causal relations in the first place. Currently, this is still a cumbersome task as causality in NL requirements is still barely understood and, thus, barely detectable. In our empirically informed research, we aim at better understanding the notion of causality and supporting the automatic extraction of causal relations in NL requirements. In a first case study, we investigate 14.983 sentences from 53 requirements documents to understand the extent and form in which causality occurs. Second, we present and evaluate a tool-supported approach, called CiRA, for causality detection. We conclude with a second case study where we demonstrate the applicability of our tool and investigate the impact of causality on NL requirements. The first case study shows that causality constitutes around 28 % of all NL requirements sentences. We then demonstrate that our detection tool achieves a macro-F-1 score of 82 % on real-world data and that it outperforms related approaches with an average gain of 11.06 % in macro-Recall and 11.43 % in macro-Precision. Finally, our second case study corroborates the positive correlations of causality with features of NL requirements. The results strengthen our confidence in the eligibility of causal relations for downstream reuse, while our tool and publicly available data constitute a first step in the ongoing endeavors of utilizing causality in RE and beyond.
引用
收藏
页码:49 / 74
页数:26
相关论文
共 50 条
  • [31] Establishing Traceability Between Natural Language Requirements and Software Artifacts by Combining RAG and LLMs
    Ali, Syed Juried
    Naganathan, Varun
    Bork, Dominik
    CONCEPTUAL MODELING, ER 2024, 2025, 15238 : 295 - 314
  • [32] EXPLORING IMPACT OF REQUIREMENTS ENGINEERING ON OTHER IT PROJECT AREAS - CASE STUDY
    Jarzebowicz, Aleksander
    Poniatowska, Katarzyna
    COMPUTER SCIENCE-AGH, 2020, 21 (03): : 261 - 286
  • [33] An NLP approach for cross-domain ambiguity detection in requirements engineering
    Ferrari, Alessio
    Esuli, Andrea
    AUTOMATED SOFTWARE ENGINEERING, 2019, 26 (03) : 559 - 598
  • [34] An NLP approach for cross-domain ambiguity detection in requirements engineering
    Alessio Ferrari
    Andrea Esuli
    Automated Software Engineering, 2019, 26 : 559 - 598
  • [35] Analyzing the Impact of Prevalence on the Evaluation of a Manual Annotation Campaign
    Fort, Karen
    Francois, Claire
    Galibert, Olivier
    Ghribi, Maha
    LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2012, : 1474 - 1480
  • [36] Information Theoretic Causality Detection between Financial and Sentiment Data
    Scaramozzino, Roberta
    Cerchiello, Paola
    Aste, Tomaso
    ENTROPY, 2021, 23 (05)
  • [37] High Resilient Asymmetry and Anomaly Detection Based on Data Causality
    Hao, Zhiyong
    Yu, Chenhao
    Zhu, Junyi
    Chang, Leilei
    SYMMETRY-BASEL, 2024, 16 (07):
  • [38] A Causality Driven Approach to Adverse Drug Reactions Detection in Tweets
    Kayesh, Humayun
    Islam, Md. Saiful
    Wang, Junhu
    ADVANCED DATA MINING AND APPLICATIONS, ADMA 2019, 2019, 11888 : 316 - 330
  • [39] Causality-based predicate detection across space and time
    Chandra, P
    Kshemkalyani, AD
    IEEE TRANSACTIONS ON COMPUTERS, 2005, 54 (11) : 1438 - 1453
  • [40] An Exploratory Study on User Interaction Challenges When Handling Interconnected Requirements Artifacts of Various Sizes
    Ghazi, Parisa
    Glinz, Martin
    2016 IEEE 24TH INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE), 2016, : 76 - 85