ARdoc: App Reviews Development Oriented Classifier

被引:81
作者
Panichella, Sebastiano [1 ]
Di Sorbo, Andrea [2 ]
Guzman, Emitza [1 ]
Visaggio, Corrado A. [2 ]
Canfora, Gerardo [2 ]
Gall, Harald [1 ]
机构
[1] Univ Zurich, Dept Informat, Zurich, Switzerland
[2] Univ Sannio, Dept Engn, Benevento, BN, Italy
来源
FSE'16: PROCEEDINGS OF THE 2016 24TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON FOUNDATIONS OF SOFTWARE ENGINEERING | 2016年
关键词
User Reviews; Mobile Applications; Natural Language Processing; Sentiment Analysis; Text Classification;
D O I
10.1145/2950290.2983938
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Google Play, Apple App Store and Windows Phone Store are well known distribution platforms where users can download mobile apps, rate them and write review comments about the apps they are using. Previous research studies demonstrated that these reviews contain important information to help developers improve their apps. However, analyzing reviews is challenging due to the large amount of reviews posted every day, the unstructured nature of reviews and its varying quality. In this demo we present ARdoc, a tool which combines three techniques: (1) Natural Language Parsing, (2) Text Analysis and (3) Sentiment Analysis to automatically classify useful feedback contained in app reviews important for performing software maintenance and evolution tasks. Our quantitative and qualitative analysis (involving mobile professional developers) demonstrates that ARdoc correctly classifies feedback useful for maintenance perspectives in user reviews with high precision (ranging between 84% and 89%), recall (ranging between 84% and 89%), and F-Measure (ranging between 84% and 89%). While evaluating our tool developers of our study confirmed the usefulness of ARdoc in extracting important maintenance tasks for their mobile applications.
引用
收藏
页码:1023 / 1027
页数:5
相关论文
共 23 条
[1]  
[Anonymous], 2014, LNICST, DOI DOI 10.1007/978-3-319-05452-04
[2]  
[Anonymous], 1992, Information retrieval: Data structures and algorithms
[3]  
[Anonymous], 2008, COLING 2008 P WORKSH
[4]  
Carreño LVG, 2013, PROCEEDINGS OF THE 35TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2013), P582, DOI 10.1109/ICSE.2013.6606604
[5]   AR-Miner: Mining Informative Reviews for Developers from Mobile App Marketplace [J].
Chen, Ning ;
Lin, Jialiu ;
Hoi, Steven C. H. ;
Xiao, Xiaokui ;
Zhang, Boshen .
36TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2014), 2014, :767-778
[6]   DECA: Development Emails Content Analyzer [J].
Di Sorbo, Andrea ;
Panichella, Sebastiano ;
Visaggio, Corrado A. ;
Di Penta, Massimiliano ;
Canfora, Gerardo ;
Gall, Harald .
2016 IEEE/ACM 38TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING COMPANION (ICSE-C), 2016, :641-644
[7]   Development Emails Content Analyzer: Intention Mining in Developer Discussions [J].
Di Sorbo, Andrea ;
Panichella, Sebastiano ;
Visaggio, Corrado A. ;
Di Penta, Massimiliano ;
Canfora, Gerardo ;
Gall, Harald C. .
2015 30TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE), 2015, :12-23
[8]  
Goul M., 2012, 2012 45th Hawaii International Conference on System Sciences (HICSS), P4168, DOI 10.1109/HICSS.2012.421
[9]  
Guzman Emitza, 2015, 2015 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). Proceedings, P1, DOI 10.1109/ESEM.2015.7321214
[10]   Ensemble Methods for App Review Classification: An Approach for Software Evolution [J].
Guzman, Emitza ;
El-Halaby, Muhammad ;
Bruegge, Bernd .
2015 30TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE), 2015, :771-776