Who's actually being Studied? A Call for Population Analysis in Software Engineering Research

被引:0
作者
Molleri, Jefferson Seide [1 ]
机构
[1] Kristiania Univ Coll, Oslo, Norway
来源
PROCEEDINGS OF THE 2024 IEEE/ACM INTERNATIONAL WORKSHOP ON METHODOLOGICAL ISSUES WITH EMPIRICAL STUDIES IN SOFTWARE ENGINEERING, WSESE 2024 | 2024年
关键词
Empirical research; population analysis; sampling; generalizability; representativeness;
D O I
10.1145/3643664.3648200
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Population analysis is crucial for ensuring that empirical software engineering (ESE) research is representative and its findings are valid. Yet, there is a persistent gap between sampling processes and the holistic examination of populations, which this position paper addresses. We explore the challenges ranging from analysing populations of individual software engineers to organizations and projects. We discuss the interplay between generalizability and transferability and advocate for appropriate population frames. We also present a compelling case for improved population analysis aiming to enhance the empirical rigor and external validity of ESE research.
引用
收藏
页码:48 / 51
页数:4
相关论文
共 14 条
[1]   Sampling in software engineering research: a critical review and guidelines [J].
Baltes, Sebastian ;
Ralph, Paul .
EMPIRICAL SOFTWARE ENGINEERING, 2022, 27 (04)
[2]  
Bissyandé TF, 2013, PROC INT SYMP SOFTW, P188, DOI 10.1109/ISSRE.2013.6698918
[3]  
de Mello RM., 2015, Journal of Software Engineering Research and Development, V3, P1, DOI DOI 10.1186/S40411-015-0023-0
[4]   A systematic review of statistical power in software engineering experiments [J].
Dyba, Tore ;
Kampenes, Vigdis By ;
Sjoberg, Dag I. K. .
INFORMATION AND SOFTWARE TECHNOLOGY, 2006, 48 (08) :745-755
[5]  
Evans Data Corporation, Worldwide Developer Population and Demographic Study 23.2
[6]   Preliminary guidelines for empirical research in software engineering [J].
Kitchenham, BA ;
Pfleeger, SL ;
Pickard, LM ;
Jones, PW ;
Hoaglin, DC ;
El Emam, K ;
Rosenberg, J .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2002, 28 (08) :721-734
[7]  
Nagappan M, 2013, P 2013 9 JOINT M FDN, V2013, P466, DOI [10.1145/2491411.2491415, DOI 10.1145/2491411.2491415]
[8]   A Study of the Characteristics of Developers' Activities in GitHub [J].
Onoue, Saya ;
Hata, Hideaki ;
Matsumoto, Ken-ichi .
2013 20TH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE (APSEC 2013), VOL 2, 2013, :7-12
[9]  
Petersen K, 2009, INT SYMP EMP SOFTWAR, P402
[10]  
Runeson P., 2012, CASE STUDY RES SOFTW