How to Ask for Donations? Learning User-Specific Persuasive Dialogue Policies through Online Interactions

被引:7
作者
Tran, Nhat [1 ]
Alikhani, Malihe [1 ]
Litman, Diane [1 ]
机构
[1] Univ Pittsburgh, Dept Comp Sci, Pittsburgh, PA 15260 USA
来源
PROCEEDINGS OF THE 30TH ACM CONFERENCE ON USER MODELING, ADAPTATION AND PERSONALIZATION, UMAP 2022 | 2022年
关键词
persuasion; dialogue; reinforcement learning;
D O I
10.1145/3503252.3531313
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Persuasive conversations are more effective when they are customtailored for the intended audience. Current persuasive dialogue systems rely heavily on advice-giving or focus on different framing policies in a constrained and less dynamic/flexible manner. In this paper, we argue for a new approach, in which the system can identify optimal persuasive strategies in context and persuade users through online interactions. We study two main questions (1) can a reinforcement-learning-based dialogue framework learn to exercise user-specific communicative strategies for persuading users? (2) How can we leverage the crowd-sourcing platforms to collect data for training, and evaluating such frameworks for humanAI(/machine) conversations? We describe a prototype system that interacts with users with the goal of persuading them to donate to a charity and use experiments with crowd workers and analyses of our learned policies to document that our approach leads to learning context-sensitive persuasive strategies that focus on user's reactions towards donation and contribute to increasing dialogue success.
引用
收藏
页码:12 / 22
页数:11
相关论文
共 27 条
  • [1] Adaji Ifeoma, 2021, UMAP '21: Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization, P325, DOI 10.1145/3450614.3464626
  • [2] Alslaity Alaa, 2021, GOAL MODELINGBASED E, P276, DOI [10.1145/3450614.3464619, DOI 10.1145/3450614.3464619]
  • [3] Asai S, 2020, PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), P491
  • [4] Chakrabarty T, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P2933
  • [5] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [6] He H, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P2333
  • [7] Hidey Christopher., 2017, P 4 WORKSH ARG MIN, P11
  • [8] Hiraoka T., 2014, Proceedings of the 25th International Conference on Computational Linguistics, P1706
  • [9] Hutto C., 2015, P 8 INT AAAI C WEBL, P216
  • [10] Kingma D P., 2014, P INT C LEARN REPR