Extracting the sentiment score of customer review from unstructured big data using map reduce algorithm

被引：0

作者：

Hassan S.I. ^{[1
]}

机构：

[1] Department of Computer Science and Engineering, Hamdard University, New Delhi

来源：

International Journal of Database Theory and Application | 2016年 / 9卷 / 12期

关键词：

Big data; HDFS; Map reduce; Opinion mining; Unstructured data;

D O I：

10.14257/ijdta.2016.9.12.26

中图分类号：

学科分类号：

摘要：

Big Data is a term used to identify the datasets that due to their large size, is very difficult to manage with traditional techniques. This data may be in the order of magnitude of petabytes. It can be found easily on web, especially on social media in the form of customer blogs, reviews and comments. Generally it is unstructured data or semi-structured data. One can use this big data to generate values by calculating sentiment score. Map Reduce is one of the most popular algorithm in Hadoop environment to perform such task. The objective of present research is to automate the process of extracting sentiments expressed about specific features of a product. For this purpose three datasets generated by Amazon for different types of electronics product reviews has been used. The data sets used consists of reviews of the products Nikon Coolpix 4300 Camera, Nokia 6601 mobile and the Canon G3camera. Map Reduce algorithm on Hadoop environment that is considered faster, reliable and fault-tolerant for processing big amounts of data in-parallel on large clusters, has been used to extract sentiment score. © 2016 SERSC.

引用

页码：289 / 298

页数：9

共 16 条

[1]

Bifet A., Mining Big data in Real time, Informatica, 37, pp. 15-20, (2013)

[2]

Cardie C., Empirical methods in information extraction, AI Magazine, 18, 4, pp. 65-79, (1997)

[3]

Agarwal A., Xie B., Vovsha I., Rambow O., Passonneau R., Sentiment analysis of Twitter data, Proceedings of ACL Workshop on Languages in Social Media, pp. 30-38, (2011)

[4]

Go A., Bhayani R., Huang L., 'Twitter sentiment classification using distant supervision', (2009)

[5]

Pang B., Lee L., Vaithyanathan S., Thumbs up? sentiment classification using machine learning techniques, Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, 10, pp. 79-86, (2002)

[6]

Hu M., Liu B., Mining and summarizing customer reviews, Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '04), pp. 168-177, (2004)

[7]

Li S., Wang Z., Lee S.Y.M., Huang C.R., Sentiment Classification with Polarity Shifting Detection, Proceedings of International Conference on Asian Language Processing (IALP), (2013)

[8]

Grivas S.G., Kaschesky M., Schaaf M., 'Feature based Opinion mining-towards Performance Measure', (2013)

[9]

Efthymios K., Theresa W., Johanna D.M., Twitter Sentiment Analysis: The Good the Bad and the OMG!, Proceedings of the Fifth International Conference on Weblogs and Social Media, pp. 538-541, (2011)

[10]

Mane S.B., Sawant Y., Kazi S., Shinde V., Real Time Sentiment Analysis of Twitter Data Using Hadoop, International Journal of Computer Science and Information Technologies, 5, 3, pp. 3098-3100, (2014)

← 1 2 →