Mouse tracking reveals structure knowledge in the absence of model-based choice

被引:19
|
作者
Konovalov, Arkady [1 ,2 ]
Krajbich, Ian [2 ,3 ]
机构
[1] Univ Zurich, Zurich Ctr Neuroecon, Dept Econ, Blumlisalpstr 10, CH-8006 Zurich, Switzerland
[2] Ohio State Univ, Dept Econ, 1945 North High St, Columbus, OH 43210 USA
[3] Ohio State Univ, Dept Psychol, 1827 Neil Ave, Columbus, OH 43210 USA
基金
美国国家科学基金会;
关键词
ARBITRATION; SYSTEMS; WINDOW;
D O I
10.1038/s41467-020-15696-w
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Converging evidence has demonstrated that humans exhibit two distinct strategies when learning in complex environments. One is model-free learning, i.e., simple reinforcement of rewarded actions, and the other is model-based learning, which considers the structure of the environment. Recent work has argued that people exhibit little model-based behavior unless it leads to higher rewards. Here we use mouse tracking to study model-based learning in stochastic and deterministic (pattern-based) environments of varying difficulty. In both tasks participants' mouse movements reveal that they learned the structures of their environments, despite the fact that standard behavior-based estimates suggested no such learning in the stochastic task. Thus, we argue that mouse tracking can reveal whether subjects have structure knowledge, which is necessary but not sufficient for model-based choice. Mouse tracking can reveal people's subjective beliefs and whether they understand the structure of a task. These data demonstrate that people often do not use this information to make good choices.
引用
收藏
页数:9
相关论文
共 37 条
  • [1] The involvement of model-based but not model-free learning signals during observational reward learning in the absence of choice
    Dunne, Simon
    D'Souza, Arun
    O'Doherty, John P.
    JOURNAL OF NEUROPHYSIOLOGY, 2016, 115 (06) : 3195 - 3203
  • [2] Explicit knowledge of task structure is a primary determinant of human model-based action
    Castro-Rodrigues, Pedro
    Akam, Thomas
    Snorasson, Ivar
    Camacho, Marta
    Paixao, Vitor
    Maia, Ana
    Barahona-Correa, J. Bernardo
    Dayan, Peter
    Simpson, H. Blair
    Costa, Rui M.
    Oliveira-Maia, Albino J.
    NATURE HUMAN BEHAVIOUR, 2022, 6 (08) : 1126 - 1141
  • [3] Rule abstraction, model-based choice, and cognitive reflection
    Don, Hilary J.
    Goldwater, Micah B.
    Otto, A. Ross
    Livesey, Evan J.
    PSYCHONOMIC BULLETIN & REVIEW, 2016, 23 (05) : 1615 - 1623
  • [4] A simple computational algorithm of model-based choice preference
    Toyama, Asako
    Katahira, Kentaro
    Ohira, Hideki
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2017, 17 (04) : 764 - 783
  • [5] Dopamine Enhances Model-Based over Model-Free Choice Behavior
    Wunderlich, Klaus
    Smittenaar, Peter
    Dolan, Raymond J.
    NEURON, 2012, 75 (03) : 418 - 424
  • [6] Cooperative Model-Based Reinforcement Learning for Approximate Optimal Tracking
    Greene, Max L.
    Bell, Zachary, I
    Nivison, Scott A.
    How, Jonathan P.
    Dixon, Warren E.
    2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 1973 - 1978
  • [7] Macroscopic model-based swarm guidance for a class of contaminant tracking applications
    Ghanavati, Meysam
    Chakravarthy, Animesh
    Menon, Prathyush P.
    INTERNATIONAL JOURNAL OF CONTROL, 2022, 95 (04) : 975 - 984
  • [8] Generative adversarial network model-based knowledge recommendation with knowledge graph in product design
    Wu, Zhenyong
    Tan, Jianxin
    Wu, Hanzhao
    Zha, Wendi
    JOURNAL OF ENGINEERING DESIGN, 2025,
  • [9] Model-Based Optimal Tracking Control Architecture For Ground-Based Telescopes.
    Basile, Giacomo
    Gonzalez, Manuel
    Petrillo, Alberto
    Santini, Stefania
    Savarese, Salvatore
    Schipani, Pietro
    GROUND-BASED AND AIRBORNE TELESCOPES X, 2024, 13094
  • [10] Evaluating the Effectiveness of Bayesian Knowledge Tracing Model-Based Explainable Recommender
    Takami, Kyosuke
    Flanagan, Brendan
    Dai, Yiling
    Ogata, Hiroaki
    INTERNATIONAL JOURNAL OF DISTANCE EDUCATION TECHNOLOGIES, 2024, 22 (01)