An Explainability-Centric Requirements Analysis Framework for Machine Learning Applications

被引：0
作者：
Pei Z. [1 ]
Liu L. [1 ]
Wang C. [1 ]
Wang J. [1 ]
机构：
[1] （National Engineering Research Center for Вig Data Software (Tsinghua University), Вeijing 100084）（School of Software, Tsinghua University, Вeijing 100084）
来源：
Jisuanji Yanjiu yu Fazhan/Computer Research and Development | 2024年 / 61卷 / 04期
关键词：
domain model; explainability; industrial engineering; machine learning; requirements engineering;
D O I：
10.7544/issn1000-1239.202220794
中图分类号：
学科分类号：
摘要：
Data-driven intelligent software based on machine learning technology is an important means to realize industrial digital transformation. The research and development processes of data-driven intelligent software require the combined use of software requirements engineering, data and domain knowledge engineering, machine learning and so on. This process involves many subjects and roles, making it extremely challenging to clearly explain why and how the domain knowledge, business logic and data semantics relate to each other. Hence, a systematic requirements engineering approach is needed to explicitly address the explainability requirements issues of data-driven intelligence applications. It is still a fast-evolving research field which requires the proper embedding of various domain models and end-to-end machine learning technology fused into a given business processes. A key research question is how to deal with explainability as a core requirement for safety-critical scenarios in industrial, medical and other applications. We provide a research overview on requirements engineering for machine learning applications, in relation to explainability. First, the research status quo, research foci and representative research progress are reviewed. Then, an explainability-centric requirements analysis framework for machine learning applications is proposed, and some open important issues are put forward. Finally, based on the proposed framework, a case study of industrial intelligence application is discussed to illustrate the proposed requirements analysis methodological framework. © 2024 Science Press. All rights reserved.
引用
收藏
页码：983 / 1002
页数：19
相关论文
共 172 条
  • [1] Ashmore R, Calinescu R, Paterson C., Assuring the machine learning lifecycle: Desiderata, methods, and challenges[J], ACM Computing Surveys, 54, 5, pp. 1-39, (2021)
  • [2] Habibullah K M, Horkoff J., Non-functional requirements for machine learning: Understanding current use and challenges in industry, Proc of the 29th IEEE Int Requirements Engineering Conf (RE), pp. 13-23, (2021)
  • [3] Mohseni S, Zarei N, Ragan E D., A multidisciplinary survey and framework for design and evaluation of explainable AI systems[J], ACM Transactions on Interactive Intelligent Systems, 11, pp. 1-45, (2021)
  • [4] Mehrabi N, Morstatter F, Saxena N, Et al., A survey on bias and fairness in machine learning[J], ACM Computing Surveys, 54, 6, pp. 1-35, (2021)
  • [5] Floridi L., Establishing the rules for building trustworthy AI[J], Nature Machine Intelligence, 1, 6, (2019)
  • [6] Ye Wang, Junwu Chen, Xin Xia, Et al., Intelligent requirements elicitation and modeling: A literature review[J], Journal of Computer Research and Development, 58, 4, (2021)
  • [7] Iqbal T, Elahidoost P, Lucio L., A bird’s eye view on requirements engineering and machine learning[C], Proc of the 25th Asia-Pacific Software Engineering Conf (APSEC), pp. 11-20, (2018)
  • [8] Villamizar H, Escovedo T, Kalinowski M., Requirements engineering for machine learning: A systematic mapping study[C], Proc of the 47th Euromicro Conf on Software Engineering and Advanced Applications (SEAA), pp. 29-36, (2021)
  • [9] Willard J, Jia Xiaowei, Xu Shaoming, Et al., Integrating physics-based modeling with machine learning: A survey, (2020)
  • [10] Harel D, Marron A, Sifakis J., Autonomics: In search of a foundation for next-generation autonomous systems[J], Proceedings of the National Academy of Sciences, 117, 30, pp. 17491-17498, (2020)
12345678910