Investigating human reading behavior during sentiment judgment

被引:2
作者
Chen, Xuesong [1 ]
Mao, Jiaxin [1 ]
Liu, Yiqun [1 ]
Zhang, Min [1 ]
Ma, Shaoping [1 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
User behavior; Eye movement; Sentiment judgment; Machine model; EYE-MOVEMENT CONTROL; MODEL;
D O I
10.1007/s13042-022-01523-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sentiment analysis is an essential task in natural language processing researches. Although existing works have gained much success with both statistical and neural-based solutions, little is known about the human decision process while performing this kind of complex cognitive task. Considering recent advances in human-inspired model design for NLP tasks, it is necessary to investigate the human reading and judging behavior in sentiment classification and adopt these findings to reconsider the sentiment analysis problem. In this paper, we carefully design a lab-based user study in which users' fine-grained reading behaviors during microblog sentiment classification are recorded with an eye-track device. Through systematic analysis of the collected data, we look into the differences between human and machine attention distributions and the differences in human attention while performing different tasks. We find that (1) sentiment judgment is more like an auxiliary task of content comprehension for humans. (2) people have different reading behavior patterns while reading microblog posts with varying labels of sentiment. Based on these findings, we build a human behavior-inspired sentiment prediction model for microblog posts. Experiment results on public-available benchmarks show that the proposed classification model outperforms existing solutions over 2.13% in terms of macro F1-score by introducing behavior features. Our findings may bring insight into the research of designing more effective and explainable sentiment analysis methods.
引用
收藏
页码:2283 / 2296
页数:14
相关论文
共 48 条
[41]  
Yadav RK, 2021, AAAI CONF ARTIF INTE, V35, P14203
[42]  
Yan G., 2011, ACTA PSYCHOL SIN, V03, P249
[43]  
Yang Z., 2016, P 2016 C N AM CHAPTE, P1480, DOI 10.18653/v1/N16-1174
[44]  
Yayla M, 2021, 2021 INT C INN INT S, P1
[45]  
Yu K, 2018, INT C LEARN REPR ICL
[46]  
Zhao Jichang., 2012, Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, P1528
[47]   EmotionMeter: A Multimodal Framework for Recognizing Human Emotions [J].
Zheng, Wei-Long ;
Liu, Wei ;
Lu, Yifei ;
Lu, Bao-Liang ;
Cichocki, Andrzej .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (03) :1110-1122
[48]   Human Behavior Inspired Machine Reading Comprehension [J].
Zheng, Yukun ;
Mao, Jiaxin ;
Liu, Yiqun ;
Ye, Zixin ;
Zhang, Min ;
Ma, Shaoping .
PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, :425-434