NoRBERT: Transfer Learning for Requirements Classification

被引:99
作者
Hey, Tobias [1 ]
Keim, Jan [1 ]
Koziolek, Anne [1 ]
Tichy, Walter F. [1 ]
机构
[1] Karlsruhe Inst Technol KIT, Inst Program Struct & Data Org, Karlsruhe, Germany
来源
2020 28TH IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE'20) | 2020年
关键词
Requirements Classification; Requirements Engineering; Machine Learning; Transfer Learning; Language Model; BERT; NONFUNCTIONAL REQUIREMENTS;
D O I
10.1109/RE48521.2020.00028
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Classifying requirements is crucial for automatically handling natural language requirements. The performance of existing automatic classification approaches diminishes when applied to unseen projects because requirements usually vary in wording and style. The main problem is poor generalization. We propose NoRBERT that fine-tunes BERT, a language model that has proven useful for transfer learning. We apply our approach to different tasks in the domain of requirements classification. We achieve similar or better results (F-1-scores of up to 94%) on both seen and unseen projects for classifying functional and non-functional requirements on the PROMISE NFR dataset. NoRBERT outperforms recent approaches at classifying non-functional requirements subclasses. The most frequent classes are classified with an average F-1-score of 87%. In an unseen project setup on a relabeled PROMISE NFR dataset, our approach achieves an improvement of 15 percentage points in average F-1-score compared to recent approaches. Additionally, we propose to classify functional requirements according to the included concerns, i.e., function, data, and behavior. We labeled the functional requirements in the PROMISE NFR dataset and applied our approach. NoRBERT achieves an F-1-score of up to 92%. Overall, NoRBERT improves requirements classification and can be applied to unseen projects with convincing results.
引用
收藏
页码:169 / 179
页数:11
相关论文
共 40 条
[1]   What Works Better? A Study of Classifying Requirements [J].
Abad, Zahra Shakeri Hossein ;
Karras, Oliver ;
Ghazi, Parisa ;
Glinz, Martin ;
Ruhe, Guenther ;
Schneider, Kurt .
2017 IEEE 25TH INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE), 2017, :496-501
[2]   The Effects of leVectorization Methods on Non-Functional Requirements Classification [J].
Amasaki, Sousuke ;
Leelaprute, Pattara .
44TH EUROMICRO CONFERENCE ON SOFTWARE ENGINEERING AND ADVANCED APPLICATIONS (SEAA 2018), 2018, :175-182
[3]  
[Anonymous], **DATA OBJECT**, DOI DOI 10.5281/ZENODO.268542
[4]  
[Anonymous], 2018, ABS180106146 CORR
[5]  
[Anonymous], 2012, The PROMISE repository of empirical software engineering data
[6]  
[Anonymous], 2013, P WORKSHOP ICLR
[7]   Rethinking Nonfunctional Software Requirements [J].
Broy, Manfred .
COMPUTER, 2015, 48 (05) :96-99
[8]  
Chung L, 2012, Non-functional requirements in software engineering
[9]   Automated classification of non-functional requirements [J].
Cleland-Huang, Jane ;
Settimi, Raffaella ;
Zou, Xuchang ;
Solc, Peter .
REQUIREMENTS ENGINEERING, 2007, 12 (02) :103-120
[10]  
Cleland-Huang J, 2006, RE'06: 14TH IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE, PROCEEDINGS, P39