Mouse tracking reveals structure knowledge in the absence of model-based choice

被引:19
|
作者
Konovalov, Arkady [1 ,2 ]
Krajbich, Ian [2 ,3 ]
机构
[1] Univ Zurich, Zurich Ctr Neuroecon, Dept Econ, Blumlisalpstr 10, CH-8006 Zurich, Switzerland
[2] Ohio State Univ, Dept Econ, 1945 North High St, Columbus, OH 43210 USA
[3] Ohio State Univ, Dept Psychol, 1827 Neil Ave, Columbus, OH 43210 USA
基金
美国国家科学基金会;
关键词
ARBITRATION; SYSTEMS; WINDOW;
D O I
10.1038/s41467-020-15696-w
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Converging evidence has demonstrated that humans exhibit two distinct strategies when learning in complex environments. One is model-free learning, i.e., simple reinforcement of rewarded actions, and the other is model-based learning, which considers the structure of the environment. Recent work has argued that people exhibit little model-based behavior unless it leads to higher rewards. Here we use mouse tracking to study model-based learning in stochastic and deterministic (pattern-based) environments of varying difficulty. In both tasks participants' mouse movements reveal that they learned the structures of their environments, despite the fact that standard behavior-based estimates suggested no such learning in the stochastic task. Thus, we argue that mouse tracking can reveal whether subjects have structure knowledge, which is necessary but not sufficient for model-based choice. Mouse tracking can reveal people's subjective beliefs and whether they understand the structure of a task. These data demonstrate that people often do not use this information to make good choices.
引用
收藏
页数:9
相关论文
共 37 条
  • [21] Design and application of nonlinear model-based tracking control schemes employing DEKF estimation
    Bhadra, Sanjay
    Panda, Atanu
    Bhowmick, Parijat
    Goswami, Shinjinee
    Panda, Rames C.
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2019, 40 (05) : 938 - 960
  • [22] Sliding-Mode Tracking Control With DNLRX Model-Based Friction Compensation for the Precision Stage
    Shen, Jing-Chung
    Lu, Qun-Zhong
    Wu, Chia-Hung
    Jywe, Wen-Yuh
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2014, 19 (02) : 788 - 797
  • [23] Model-Based Algorithm for Flexible Power Point Tracking for Photovoltaic Participation in Primary Frequency Regulation
    Cristaldi, Loredana
    Faifer, Marco
    Laurano, Christian
    Petkovski, Emil
    Ponci, Ferdinanda
    Sowa, Igor
    Toscani, Sergio
    ENERGIES, 2024, 17 (09)
  • [24] Adaptive Neural Network Model-based Event-triggered Attitude Tracking Control for Spacecraft
    Xie, Hongyi
    Wu, Baolin
    Liu, Weixing
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2021, 19 (01) : 172 - 185
  • [25] A Novel Internal Model-Based Tracking Control for a Class of Linear Time-Varying Plants
    Zhang, Zhen
    Sun, Zongxuan
    2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, : 5339 - 5344
  • [26] Bouc-Wen model-based real-time force tracking scheme for MR dampers
    Weber, F.
    SMART MATERIALS AND STRUCTURES, 2013, 22 (04)
  • [27] Dependency Model-Based Multiple Fault Diagnosis Using Knowledge of Test Result and Fault Prior Probability
    Lv, Xiaofeng
    Zhou, Deyun
    Ma, Ling
    Tang, Yongchuan
    APPLIED SCIENCES-BASEL, 2019, 9 (02):
  • [28] From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning
    Decker, Johannes H.
    Otto, A. Ross
    Daw, Nathaniel D.
    Hartley, Catherine A.
    PSYCHOLOGICAL SCIENCE, 2016, 27 (06) : 848 - 858
  • [29] Model-Based Supervisory Control Structure for Plantwide Control of a Reactor-Separator-Recycle Plant
    Moscoso-Vasquez, Hilda M.
    Monsalve-Bravo, Gloria M.
    Alvarez, Hernan
    INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2014, 53 (52) : 20177 - 20190
  • [30] Model-based event-triggered multi-vehicle coordinated tracking control using reduced order models
    Garcia, Eloy
    Cao, Yongcan
    Casbeer, David W.
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2014, 351 (08): : 4271 - 4286