Enhancing social media analysis with visual data analytics: A deep learning approach

被引:0
作者
Shin D. [1 ]
He S. [2 ]
Lee G.M. [3 ]
Whinston A.B. [4 ]
Cetintas S. [5 ]
Lee K.-C. [6 ]
机构
[1] W. P. Carey School of Business, Arizona State University, Tempe, 85281, AZ
[2] School of Business, University of Connecticut, 2100 Hillside Road, Storrs, 06269, CT
[3] Sauder School of Business, University of British Columbia, 2053 Main Mall, Vancouver, V6T 1Z2, BC
[4] McCombs School of Business, University of Texas at Austin, 2110 Speedway, Austin, 78705, TX
[5] Advertising Science, Yahoo! Research, 701 First Avenue, Sunnyvale, 94089, CA
[6] Marketplace Optimization, Alibaba Group, 400 S. El Camino Real, San Mateo, 94402, CA
来源
MIS Quarterly: Management Information Systems | 2020年 / 44卷 / 04期
基金
美国国家科学基金会;
关键词
Deep learning; Image-text similarity; Machine learning; Prediction; Social media; Visual data analytics; Word embedding;
D O I
10.25300/MISQ/2020/14435
中图分类号
学科分类号
摘要
This research methods article proposes a visual data analytics framework to enhance social media research using deep learning models. Drawing on the literature of information systems and marketing, complemented with data-driven methods, we propose a number of visual and textual content features including complexity, similarity, and consistency measures that can play important roles in the persuasiveness of social media content. We then employ state-of-the-art machine learning approaches such as deep learning and text mining to operationalize these new content features in a scalable and systematic manner. For the newly developed features, we validate them against human coders on Amazon Mechanical Turk. Furthermore, we conduct two case studies with a large social media dataset from Tumblr to show the effectiveness of the proposed content features. The first case study demonstrates that both theoretically motivated and data-driven features significantly improve the model's power to predict the popularity of a post, and the second one highlights the relationships between content features and consumer evaluations of the corresponding posts. The proposed research framework illustrates how deep learning methods can enhance the analysis of unstructured visual and textual data for social media research. © 2020 University of Minnesota. All rights reserved.
引用
收藏
页码:1459 / 1492
页数:33
相关论文
共 131 条
[1]  
Abadi M., Agarwal A., Barham P., Brevdo E., Chen Z., Citro C., Corrado G. S., Davis A., Dean J., Devin M., Ghemawat S., Goodfellow I., Harp A., Irving G., Isard M., Jia Y., Jozefowicz R., Kaiser L., Kudlur M., Levenberg J., Mane D., Monga R., Moore S., Murray D., Olah C., Schuster M., Shlens J., Steiner B., Sutskever I., Talwar K., Tucker P., Vanhoucke V., Vasudevan V., Viegas F., Vinyals O., Warden P., Wattenberg M., Wicke M., Yu Y., Zheng X., TensorFlow: Large-Scale Machine Learning on Heterog
[2]  
Abbasi A., Li J., Clifford G., Taylor H., Make 'Fairness by Design' Part of Machine Learning, Harvard Business Review, (2018)
[3]  
Adomavicius G., Bockstedt J., Curley S. P., Bundling Effects on Variety Seeking for Digital Information Goods, Journal of Management Information Systems, 31, 4, pp. 182-212, (2015)
[4]  
Agrawal J., Kamakura W. A., The Economic Worth of Celebrity Endorsers: An Event Study Analysis, Journal of Marketing, 59, 3, pp. 56-62, (1995)
[5]  
Arun R., Suresh V., Madhavan C. V., Murthy M. N., On Finding the Natural Number of Topics with Latent Dirichlet Allocation: Some Observations, Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining: Advances in Knowledge Discovery and Data Mining, pp. 391-402, (2010)
[6]  
Attneave F., Some Informational Aspects of Visual Perception, Psychological Review, 61, 3, pp. 183-193, (1954)
[7]  
Bandari R., Asur S., Huberman B. A., The Pulse of News in Social Media: Forecasting Popularity, Proceedings of the 6th International AAAI Conference on Weblogs and Social Media, pp. 26-33, (2012)
[8]  
Barsoum E., Zhang C., Ferrer C. C., Zhang Z., Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distribution, Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 279-283, (2016)
[9]  
Bengio Y., Courville A., Vincent P., Representation Learning: A Review and New Perspectives, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 8, pp. 1798-1828, (2013)
[10]  
Blei D. M., Ng A. Y., Jordan M. I., Latent Dirichlet Allocation, Journal of Machine Learning Research, 3, pp. 993-1022, (2003)