Unsupervised Deep Domain Adaptation for Heterogeneous Defect Prediction

被引:10
作者
Gong, Lina [1 ,2 ]
Jiang, Shujuan [1 ,3 ]
Yu, Qiao [4 ]
Jiang, Li [1 ,3 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou, Jiangsu, Peoples R China
[2] Zaozhuang Univ, Dept Informat Sci & Engn, Zaozhuang, Peoples R China
[3] Minist Educ, Engn Res Ctr Mine Digitalizat, Xuzhou, Jiangsu, Peoples R China
[4] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
heterogeneous defect prediction; neural networks; maximum mean discrepancy; class-imbalance;
D O I
10.1587/transinf.2018EDP7289
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Heterogeneous defect prediction (HDP) is to detect the largest number of defective software modules in one project by using historical data collected from other projects with different metrics. However, these data can not be directly used because of different metrics set among projects. Meanwhile, software data have more non-defective instances than defective instances which may cause a significant bias towards defective instances. To completely solve these two restrictions, we propose unsupervised deep domain adaptation approach to build a HDP model. Specifically, we firstly map the data of source and target projects into a unified metric representation (UMR). Then, we design a simple neural network (SNN) model to deal with the heterogeneous and class-imbalanced problems in software defect prediction (SDP). In particular, our model introduces the Maximum Mean Discrepancy (MMD) as the distance between the source and target data to reduce the distribution mismatch, and use the cross-entropy loss function as the classification loss. Extensive experiments on 18 public projects from four datasets indicate that the proposed approach can build an effective prediction model for heterogeneous defect prediction (HDP) and outperforms the related competing approaches.
引用
收藏
页码:537 / 549
页数:13
相关论文
共 47 条
[1]  
[Anonymous], IEEE T NEURAL NETW
[2]   The dropout learning algorithm [J].
Baldi, Pierre ;
Sadowski, Peter .
ARTIFICIAL INTELLIGENCE, 2014, 210 :78-122
[3]  
Bennett K., 2018, ENCY PERSONALITY IND, P1, DOI 10.1007/978-3-319-28099-81627-1
[4]   MAHAKIL: Diversity Based Oversampling Approach to Alleviate the Class Imbalance Issue in Software Defect Prediction [J].
Benni, Kwabena Ebo ;
Keung, Jacky ;
Phannachitta, Passakorn ;
Monden, Akito ;
Mensah, Solomon .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2018, 44 (06) :534-550
[5]   High order accurate conservative remapping scheme on polygonal meshes using a posteriori MOOD limiting [J].
Blanchard, Ghislain ;
Loubere, Raphael .
COMPUTERS & FLUIDS, 2016, 136 :83-103
[6]  
Cheng M., 2016, 28 INT C SOFTWARE EN, P171
[7]   Evaluating defect prediction approaches: a benchmark and an extensive comparison [J].
D'Ambros, Marco ;
Lanza, Michele ;
Robbes, Romain .
EMPIRICAL SOFTWARE ENGINEERING, 2012, 17 (4-5) :531-577
[8]  
He P., 2014, COMPUTER SCI
[9]   An investigation on the feasibility of cross-project defect prediction [J].
He, Zhimin ;
Shu, Fengdi ;
Yang, Ye ;
Li, Mingshu ;
Wang, Qing .
AUTOMATED SOFTWARE ENGINEERING, 2012, 19 (02) :167-199
[10]  
Herbold S., 2016, EMPIR SOFTW ENG, V22, P1