Quantum reinforcement learning during human decision-making

被引:0
|
作者
Ji-An Li
Daoyi Dong
Zhengde Wei
Ying Liu
Yu Pan
Franco Nori
Xiaochu Zhang
机构
[1] University of Science and Technology of China,Eye Center, Dept. of Ophthalmology, the First Affiliated Hospital of USTC, Hefei National Laboratory for Physical Sciences at the Microscale, School of Life Sciences, Division of Life Sciences and Medicine
[2] University of Science and Technology of China,Department of Statistics and Finance, School of Management
[3] University of New South Wales,School of Engineering and Information Technology
[4] Shanghai Jiao Tong University School of Medicine,Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Centre
[5] University of Science and Technology of China,The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine
[6] Shanghai International Studies University,Key Laboratory of Applied Brain and Cognitive Sciences, School of Business and Management
[7] RIKEN Cluster for Pioneering Research,Theoretical Quantum Physics Laboratory
[8] The University of Michigan,Department of Physics
[9] Anhui Mental Health Centre,Hefei Medical Research Centre on Alcohol Addiction
[10] Tianjin Normal University,Academy of Psychology and Behaviour
[11] University of Science and Technology of China,Centres for Biomedical Engineering
来源
Nature Human Behaviour | 2020年 / 4卷
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Classical reinforcement learning (CRL) has been widely applied in neuroscience and psychology; however, quantum reinforcement learning (QRL), which shows superior performance in computer simulations, has never been empirically tested on human decision-making. Moreover, all current successful quantum models for human cognition lack connections to neuroscience. Here we studied whether QRL can properly explain value-based decision-making. We compared 2 QRL and 12 CRL models by using behavioural and functional magnetic resonance imaging data from healthy and cigarette-smoking subjects performing the Iowa Gambling Task. In all groups, the QRL models performed well when compared with the best CRL models and further revealed the representation of quantum-like internal-state-related variables in the medial frontal gyrus in both healthy subjects and smokers, suggesting that value-based decision-making can be illustrated by QRL at both the behavioural and neural levels.
引用
收藏
页码:294 / 307
页数:13
相关论文
共 50 条
  • [1] Quantum reinforcement learning during human decision-making
    Li, Ji-An
    Dong, Daoyi
    Wei, Zhengde
    Liu, Ying
    Pan, Yu
    Nori, Franco
    Zhang, Xiaochu
    NATURE HUMAN BEHAVIOUR, 2020, 4 (03) : 294 - 307
  • [2] Reinforcement learning with hierarchical decision-making
    Cohen, Shahar
    Maimon, Oded
    Khmlenitsky, Evgeni
    ISDA 2006: SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 3, 2006, : 177 - +
  • [3] Decision analysis and reinforcement learning in surgical decision-making
    Loftus, Tyler J.
    Filiberto, Amanda C.
    Li, Yanjun
    Balch, Jeremy
    Cook, Allyson C.
    Tighe, Patrick J.
    Efron, Philip A.
    Upchurch, Gilbert R., Jr.
    Rashidi, Parisa
    Li, Xiaolin
    Bihorac, Azra
    SURGERY, 2020, 168 (02) : 253 - 266
  • [4] REINFORCEMENT LEARNING FOR DECISION-MAKING IN A BUSINESS SIMULATOR
    Garcia, Javier
    Borrajo, Fernando
    Fernandez, Fernando
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2012, 11 (05) : 935 - 960
  • [5] Transformer in reinforcement learning for decision-making: a survey
    Yuan, Weilin
    Chen, Jiaxing
    Chen, Shaofei
    Feng, Dawei
    Hu, Zhenzhen
    Li, Peng
    Zhao, Weiwei
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2024, 25 (06) : 763 - 790
  • [6] Quantum dynamics of human decision-making
    Busemeyer, Jerome R.
    Wang, Zheng
    Townsend, James T.
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2006, 50 (03) : 220 - 241
  • [7] Invited: Efficient Reinforcement Learning for Automating Human Decision-Making in SoC Design
    Sadasivam, Shankar
    Chen, Zhuo
    Lee, Jinwon
    Jain, Rajeev
    2018 55TH ACM/ESDA/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2018,
  • [8] Reinforcement learning for decision-making under deep uncertainty
    Pei, Zhihao
    Rojas-Arevalo, Angela M.
    de Haan, Fjalar J.
    Lipovetzky, Nir
    Moallemi, Enayat A.
    JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2024, 359
  • [9] Application of Reinforcement Learning in Multiagent Intelligent Decision-Making
    Han, Xiaoyu
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [10] Thinking as human: Self-reflective reinforcement learning framework for fertilization decision-making
    Li, Shulang
    Liu, Jie
    Yang, Yang
    Shen, Rujia
    Jiang, Jingchi
    SMART AGRICULTURAL TECHNOLOGY, 2025, 10