Controlling for Selection Bias in Social Media Indicators through Official Statistics: a Proposal

被引:10
|
作者
Iacus, Stefano M. [1 ]
Porro, Giuseppe [2 ]
Salini, Silvia [1 ]
Siletti, Elena [1 ]
机构
[1] Univ Milan, Dept Econ Management & Quantitat Methods, Via Conservatorio 7, I-20122 Milan, Italy
[2] Univ Insubria, Dept Law Econ & Culture, Via St Abbondio 12, I-22100 Como, Italy
关键词
Well-being; big data; sentiment analysis; small area estimation; weighting; SMALL-AREA ESTIMATION; BIG DATA; TIME-SERIES; FUTURE; INCOME;
D O I
10.2478/JOS-2020-0017
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
With the increase of social media usage, a huge new source of data has become available. Despite the enthusiasm linked to this revolution, one of the main outstanding criticisms in using these data is selection bias. Indeed, the reference population is unknown. Nevertheless, many studies show evidence that these data constitute a valuable source because they are more timely and possess higher space granularity. We propose to adjust statistics based on Twitter data by anchoring them to reliable official statistics through a weighted, space-time, small area estimation model. As a by-product, the proposed method also stabilizes the social media indicators, which is a welcome property required for official statistics. The method can be adapted anytime official statistics exists at the proper level of granularity and for which social media usage within the population is known. As an example, we adjust a subjective wellbeing indicator of "working conditions" in Italy, and combine it with relevant official statistics. The weights depend on broadband coverage and the Twitter rate at province level, while the analysis is performed at regional level. The resulting statistics are then compared with survey statistics on the "quality of job" at macro-economic regional level, showing evidence of similar paths.
引用
收藏
页码:315 / 338
页数:24
相关论文
共 4 条
  • [1] Social media as a data source for official statistics; the Dutch Consumer Confidence Index
    van den Brakel, Jan
    Sohler, Emily
    Daas, Piet
    Buelens, Bart
    SURVEY METHODOLOGY, 2017, 43 (02) : 183 - 210
  • [2] Soft Data and Public Policy: Can Social Media Offer Alternatives to Official Statistics in Urban Policymaking?
    Severo, Marta
    Feredj, Amel
    Romele, Alberto
    POLICY AND INTERNET, 2016, 8 (03): : 354 - 372
  • [3] The development of tourism indicators through the use of social media data: the case of Minas Gerais, Brazil
    de Oliveira, Rafael Almeida
    Abrantes Baracho, Renata Maria
    INFORMATION RESEARCH-AN INTERNATIONAL ELECTRONIC JOURNAL, 2018, 23 (04):
  • [4] Can We Assess Mental Health Through Social Media and Smart Devices? Addressing Bias in Methodology and Evaluation
    Tsakalidis, Adam
    Liakata, Maria
    Damoulas, Theo
    Cristea, Alexandra, I
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT III, 2019, 11053 : 407 - 423