Deep-transfer learning inspired natural language processing system for software requirements classification

被引:0
作者
Saqib, Mohd [1 ,5 ]
Mustaqeem, Mohd [2 ]
Jawed, Md Saquib [2 ,6 ]
Abdulaziz, Alsolami [3 ]
Khan, Anish [4 ]
Khan, Jeeshan [2 ]
机构
[1] Indian Inst Technol ISM, Dept Math & Comp, Dhanbad, JH, India
[2] Aligarh Muslim Univ, Dept Comp Sci, Aligarh, Uttar Pradesh, India
[3] King Abdulaziz Univ, Dept Special Educ, Jeddah 21589, Saudi Arabia
[4] King Abdulaziz Univ, Ctr Excellence Adv Mat Res, Jeddah 21589, Saudi Arabia
[5] McGill Univ, Sch Informat Studies, Quebec City, PQ, Canada
[6] Bennett Univ, Sch Comp Sci Engn & Technol, Noida, India
关键词
Functional requirements; Software engineering; Natural language processing; Transfer learning; Recurrent neural network; NONFUNCTIONAL REQUIREMENTS;
D O I
10.1007/s10115-024-02248-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the software engineering domain, the distinction between functional (FRs) and non-functional requirements (NFRs) is paramount, as it directly influences the design and development of software systems. However, several challenges, such as dealing with limited training data, domain-specific datasets, and high computational costs, have driven the need for innovative solutions, particularly those related to classifying functional and non-functional software requirements. The limited availability of labeled data for training deep learning models and their high computational costs have hindered progress. This study proposes a novel hierarchical transfer learning (HTL) approach to address the challenges of limited training data and high computational costs associated with deep learning models. The HTL model leverages transfer learning techniques, incorporating pre-trained models such as global vectors for word representation (GloVe) for text vectorization and a bidirectional long short-term memory (BiLSTM) architecture. By harnessing knowledge from large text corpora and capturing both high-level semantic relationships and detailed syntactic patterns, the HTL model demonstrates enhanced classification performance. We have evaluated the model's performance using precision, recall, F1-score, and the area under the receiver operating characteristic curve. For FRs classification, we have observed a 26% improvement in precision, a 9% improvement in recall, and an 18% in F1-score for small datasets. Similarly, for NFRs, classification achieves a 20% improvement in precision, a 38.8% improvement in recall, and a 31.8% improvement in F1-score. For large datasets, we have observed a 25% improvement in precision, a 7% improvement in recall, and a 15% improvement in F1-score for FRs classification. For NFRs classification, it achieves a 24% improvement in precision, a 39.8% improvement in recall, and a 41.8% improvement in F1-score. Our study presents a pioneering HTL approach for FRs and NFRs classification, demonstrating superior performance compared to traditional methods. Furthermore, we identify areas for future research, including improving model interpretability, handling data biases, and fine-tuning hyperparameters, which will further enhance the capabilities and applicability of the HTL model.
引用
收藏
页码:839 / 861
页数:23
相关论文
共 28 条
[1]   What Works Better? A Study of Classifying Requirements [J].
Abad, Zahra Shakeri Hossein ;
Karras, Oliver ;
Ghazi, Parisa ;
Glinz, Martin ;
Ruhe, Guenther ;
Schneider, Kurt .
2017 IEEE 25TH INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE), 2017, :496-501
[2]  
[Anonymous], 1990, IEEE Std, DOI [10.1109/IEEESTD.1990.101064, DOI 10.1109/IEEESTD.1990.101064]
[3]  
Anton A.I., 1997, GOAL IDENTIFICATION
[4]   Annotation of Software Requirements Specification (SRS), Extractions of Nonfunctional Requirements, and Measurement of Their Tradeoff [J].
Asif, Muhammad ;
Ali, Ishfaq ;
Malik, Muhamad Sheraz Arshed ;
Chaudary, Muhammad Hasanain ;
Tayyaba, Shahzadi ;
Mahmood, Muhammad Tariq .
IEEE ACCESS, 2019, 7 :36164-36176
[5]   Automatic Multi-class Non-Functional Software Requirements Classification Using Neural Networks [J].
Baker, Cody ;
Deng, Lin ;
Chakraborty, Suranjan ;
Dehlinger, Josh .
2019 IEEE 43RD ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), VOL 2, 2019, :610-615
[6]   Software Requirements Classification Using Machine Learning Algorithms [J].
Dias Canedo, Edna ;
Cordeiro Mendes, Bruno .
ENTROPY, 2020, 22 (09)
[7]  
Fernandes Joao M., 2016, Requirements in Engineering Projects
[8]  
Hanin B, 2018, ADV NEUR IN, V31
[9]   The vanishing gradient problem during learning recurrent neural nets and problem solutions [J].
Hochreiter, S .
INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 1998, 6 (02) :107-116
[10]  
Khayashi F, DEEP LEARNING METHOD