A Conceptual Model for Labeling in Reinforcement Learning Systems: A Value Co-creation Perspective

被引:0
|
作者
Reinhard, Philipp [1 ]
Li, Mahei Manhai [1 ]
Dickhaut, Ernestine [1 ]
Reh, Cornelius [1 ]
Peters, Christoph [1 ,2 ]
Leimeister, Jan Marco [1 ,2 ]
机构
[1] Univ Kassel, Kassel, Germany
[2] Univ St Gallen, St Gallen, Switzerland
来源
DESIGN SCIENCE RESEARCH FOR A NEW SOCIETY: SOCIETY 5.0, DESRIST 2023 | 2023年 / 13873卷
关键词
Human-in-the-loop; Interactive labeling; Artificial intelligence; Value co-creation; DESIGN SCIENCE RESEARCH; SERVICE-DOMINANT LOGIC; PRINCIPLES; PEOPLE; POWER;
D O I
10.1007/978-3-031-32808-4_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence (AI) possesses the potential to augment customer service employees e.g. via decision support or solution recommendations. Still, its underlying data for training and testing the AI systems is provided by human annotators through human-in-the-loop configurations. However, due to the high effort for annotators and lack of incentives, AI systems face low underlying data quality. That in turn results in low prediction performance and limited acceptance by the targeted user group. Faced with the enormous volume and increasing complexity of service requests, IT service management (ITSM) especially, relies on high data quality for AI systems and incorporating domain-specific knowledge. By analyzing the existing labeling process in that specific case, we design a revised to-be process and develop a conceptual model from a value co-creation perspective. Finally, a functional prototype as an instantiation in the ITSM domain is implemented and evaluated through accuracy metrics and user evaluation. The results show that the new process increases the perceived value of both labeling quality and the perceived prediction quality. Thus, we contribute a conceptual model that supports the systematic design of efficient and interactive labeling processes in diverse applications of reinforcement learning systems.
引用
收藏
页码:123 / 137
页数:15
相关论文
共 50 条
  • [31] A game theory approach for value co-creation systems
    Truong Hong Trinh
    Nguyen Thanh Liem
    Kachitvichyanukul, Voratas
    PRODUCTION AND MANUFACTURING RESEARCH-AN OPEN ACCESS JOURNAL, 2014, 2 (01): : 253 - 265
  • [32] The players' perspective of value co-creation in esports service ecosystems
    Roth, Alexander
    Kunz, Reinhard E.
    Kolo, Castulus
    JOURNAL OF MEDIA BUSINESS STUDIES, 2023,
  • [33] Developing the value co-creation scale from an organisational perspective
    ul Haque, Mobin
    MIDDLE EAST JOURNAL OF MANAGEMENT, 2022, 9 (06) : 640 - 664
  • [34] Sustaining extended enterprise performance: a value co-creation perspective
    Bobbink M.
    Hartmann A.
    Dewulf G.
    Journal of Organization Design, 5 (1)
  • [35] A perspective on value co-creation processes in eSports service ecosystems
    Kunz, Reinhard E.
    Roth, Alexander
    Santomier, James P.
    SPORT BUSINESS AND MANAGEMENT-AN INTERNATIONAL JOURNAL, 2022, 12 (01) : 29 - 53
  • [36] Identifying the Value Co-Creation Model and Upgrading Path of Manufacturing Enterprises from the Value Network Perspective
    Li, Gang
    Wu, Jiayi
    Li, Ning
    SUSTAINABILITY, 2022, 14 (23)
  • [37] Co-Creation and Interdisciplinary Perspective
    Journal of the Institute of Electrical Engineers of Japan, 2022, 142 (08):
  • [38] Managing the co-creation of value
    Payne, Adrian F.
    Storbacka, Kaj
    Frow, Pennie
    JOURNAL OF THE ACADEMY OF MARKETING SCIENCE, 2008, 36 (01) : 83 - 96
  • [39] A practical model of value co-creation in healthcare service
    Zhang, Le
    Tong, Hangjun
    Demirel, H. Onan
    Duffy, Vincent G.
    Yih, Yuehwern
    Bidassie, Balmatee
    6TH INTERNATIONAL CONFERENCE ON APPLIED HUMAN FACTORS AND ERGONOMICS (AHFE 2015) AND THE AFFILIATED CONFERENCES, AHFE 2015, 2015, 3 : 200 - 207
  • [40] Managing the co-creation of value
    Adrian F. Payne
    Kaj Storbacka
    Pennie Frow
    Journal of the Academy of Marketing Science, 2008, 36 : 83 - 96