Forecasting influenza-like illness dynamics for military populations using neural networks and social media

被引:67
作者
Volkova, Svitlana [1 ]
Ayton, Ellyn [1 ]
Porterfield, Katherine [1 ]
Corley, Courtney D. [1 ]
机构
[1] Pacific Northwest Natl Lab, Data Sci & Analyt Grp, Comp & Analyt Div, Natl Secur Directorate, Richland, WA 99352 USA
关键词
HEALTH; SURVEILLANCE;
D O I
10.1371/journal.pone.0188941
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This work is the first to take advantage of recurrent neural networks to predict influenza-like illness (ILI) dynamics from various linguistic signals extracted from social media data. Unlike other approaches that rely on timeseries analysis of historical ILI data and the state-of-the-art machine learning models, we build and evaluate the predictive power of neural network architectures based on Long Short Term Memory (LSTMs) units capable of nowcasting (predicting in "feminine ordinal indicator" real-time") and forecasting (predicting the future) ILI dynamics in the 2011 - 2014 influenza seasons. To build our models we integrate information people post in social media e.g., topics, embeddings, word ngrams, stylistic patterns, and communication behavior using hashtags and mentions. We then quantitatively evaluate the predictive power of different social media signals and contrast the performance of the-state-of-the-art regression models with neural networks using a diverse set of evaluation metrics. Finally, we combine ILI and social media signals to build a joint neural network model for ILI dynamics prediction. Unlike the majority of the existing work, we specifically focus on developing models for local rather than national ILI surveillance, specifically for military rather than general populations in 26 U.S. and six international locations., and analyze how model performance depends on the amount of social media data available per location. Our approach demonstrates several advantages: (a) Neural network architectures that rely on LSTM units trained on social media data yield the best performance compared to previously used regression models. (b) Previously under-explored language and communication behavior features are more predictive of ILI dynamics than stylistic and topic signals expressed in social media. (c) Neural network models learned exclusively from social media signals yield comparable or better performance to the models learned from ILI historical data, thus, signals from social media can be potentially used to accurately forecast ILI dynamics for the regions where ILI historical data is not available. (d) Neural network models learned from combined ILI and social media signals significantly outperform models that rely solely on ILI historical data, which adds to a great potential of alternative public sources for ILI dynamics prediction. (e) Location-specific models outperform previously used location-independent models e.g., U.S. only. (f) Prediction results significantly vary across geolocations depending on the amount of social media data available and ILI activity patterns. (g) Model performance improves with more tweets available per geo-location e.g., the error gets lower and the Pearson score gets higher for locations with more tweets.
引用
收藏
页数:22
相关论文
共 32 条
[1]   Enhancing disease surveillance with novel data streams: challenges and opportunities [J].
Althouse, Benjamin M. ;
Scarpino, Samuel V. ;
Meyers, Lauren Ancel ;
Ayers, John W. ;
Bargsten, Marisa ;
Baumbach, Joan ;
Brownstein, John S. ;
Castro, Lauren ;
Clapham, Hannah ;
Cummings, Derek A. T. ;
Del Valle, Sara ;
Eubank, Stephen ;
Fairchild, Geoffrey ;
Finelli, Lyn ;
Generous, Nicholas ;
George, Dylan ;
Harper, David R. ;
Hebert-Dufresne, Laurent ;
Johansson, Michael A. ;
Konty, Kevin ;
Lipsitch, Marc ;
Milinovich, Gabriel ;
Miller, Joseph D. ;
Nsoesie, Elaine O. ;
Olson, Donald R. ;
Paul, Michael ;
Polgreen, Philip M. ;
Priedhorsky, Reid ;
Read, Jonathan M. ;
Rodriguez-Barraquer, Isabel ;
Smith, Derek J. ;
Stefansen, Christian ;
Swerdlow, David L. ;
Thompson, Deborah ;
Vespignani, Alessandro ;
Wesolowski, Amy .
EPJ DATA SCIENCE, 2015, 4 (01) :1-8
[2]   Latent Dirichlet allocation [J].
Blei, DM ;
Ng, AY ;
Jordan, MI .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (4-5) :993-1022
[3]   National and Local Influenza Surveillance through Twitter: An Analysis of the 2012-2013 Influenza Epidemic [J].
Broniatowski, David A. ;
Paul, Michael J. ;
Dredze, Mark .
PLOS ONE, 2013, 8 (12)
[4]  
Brownstein John S, 2006, AMIA Annu Symp Proc, P866
[5]  
Charron L, 2015, PLOS ONE, V10, DOI [10.1371/journal.pone.0125154, 10.1371/journal.pone.0139701]
[6]   Social and News Media Enable Estimation of Epidemiological Patterns Early in the 2010 Haitian Cholera Outbreak [J].
Chunara, Rumi ;
Andrews, Jason R. ;
Brownstein, John S. .
AMERICAN JOURNAL OF TROPICAL MEDICINE AND HYGIENE, 2012, 86 (01) :39-45
[7]  
Coppersmith G, 2014, P ICWSM
[8]   Text and Structural Data Mining of Influenza Mentions in Web and Social Media [J].
Corley, Courtney D. ;
Cook, Diane J. ;
Mikler, Armin R. ;
Singh, Karan P. .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2010, 7 (02) :596-615
[9]  
Das Debjani, 2005, MMWR Suppl, V54, P41
[10]  
Deng L., 2014, FOND T SIGN PROC, V7, P197, DOI DOI 10.1561/2000000039