Putting the Ghost in the Machine: Emulating Cognitive Style in Large Language Models

被引:0
作者
Agarwal, Vasvi [1 ]
Jablokow, Kathryn [2 ]
Mccomb, Christopher [1 ]
机构
[1] Carnegie Mellon Univ, Dept Mech Engn, 5000 Forbes Ave,4126 Wean Hall, Pittsburgh, PA 15213 USA
[2] Penn State Univ, Sch Engn Design & Innovat, 30 East,Swedesford Rd, Malvern, PA 19355 USA
关键词
machine learning for engineering applications; Kirton's Adaption-Innovation theory; large language models; artificial intelligence in design; prompt engineering; generative AI; ADAPTION-INNOVATION THEORY; IDEAS; CREATIVITY; ADAPTORS;
D O I
10.1115/1.4066857
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Large Language Models (LLMs) have emerged as pivotal technology in the evolving world. Their significance in design lies in their transformative potential to support engineers and collaborate with design teams throughout the design process. However, it is not known whether LLMs can emulate the cognitive and social attributes which are known to be important during design, such as cognitive style. This research evaluates the efficacy of LLMs to emulate aspects of Kirton's Adaption-Innovation theory, which characterizes individual preferences in problem-solving. Specifically, we use LLMs to generate solutions for three design problems using two different cognitive style prompts (adaptively framed and innovatively framed). Solutions are evaluated with respect to feasibility and paradigm relatedness, which are known to have discriminative value in other studies of cognitive style. We found that solutions generated using the adaptive prompt tend to display higher feasibility and are paradigm-preserving, while solutions generated using the innovative prompts were more paradigm-modifying. This aligns with prior work and expectations for design behavior based on Kirton's Adaption-Innovation theory. Ultimately, these results demonstrate that LLMs can be prompted to accurately emulate cognitive style.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Team role preference and cognitive styles - A convergent validity study
    Aritzeta, A
    Senior, B
    Swailes, S
    [J]. SMALL GROUP RESEARCH, 2005, 36 (04) : 404 - 436
  • [2] How Does Cognitive Conflict in Design Teams Support the Development of Creative Ideas?
    Badke-Schaub, Petra
    Goldschmidt, Gabriela
    Meijer, Martijn
    [J]. CREATIVITY AND INNOVATION MANAGEMENT, 2010, 19 (02) : 119 - 133
  • [3] Bai L., 2023, Brain-X, V1, DOI [10.1002/brx2.30, DOI 10.1002/BRX2.303]
  • [4] Bosley M., 2023, Do we still need BERT in the age of GPT? Comparing the benefits of domain-adaptation and in-context-learning approaches to using LLMs for political science research
  • [5] Brown TB, 2020, ADV NEUR IN, V33
  • [6] Buffinton K. W., 2002, ASEE ANN C P MONTR C, P10031
  • [7] A Survey on Evaluation of Large Language Models
    Chang, Yupeng
    Wang, Xu
    Wang, Jindong
    Wu, Yuan
    Yang, Linyi
    Zhu, Kaijie
    Chen, Hao
    Yi, Xiaoyuan
    Wang, Cunxiang
    Wang, Yidong
    Ye, Wei
    Zhang, Yue
    Chang, Yi
    Yu, Philip S.
    Yang, Qiang
    Xie, Xing
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2024, 15 (03)
  • [8] Chiarello F., 2024, Proceedings of the Design Society, V4, P1959, DOI [10.1017/pds.2024.198, DOI 10.1017/PDS.2024.198]
  • [9] Adaption-innovation theory and knowledge use in organizations
    Chilton, Michael A.
    Bloodgood, James M.
    [J]. MANAGEMENT DECISION, 2010, 48 (7-8) : 1159 - 1180
  • [10] Chowdhary KR, 2020, Fundam Artif Intell, P603, DOI 10.1007/978-81-322-3972-7_19