Why Do Individuals Seek Information? A Selectionist Perspective

被引:4
作者
Borgstede, Matthias [1 ]
机构
[1] Univ Bamberg, Fdn Educ, Bamberg, Germany
关键词
behavioral selection; natural selection; information theory; Fisher information; entropy; multilevel model of behavioral selection; covariance based law of effect; free energy principle; FREE-ENERGY PRINCIPLE; NATURAL-SELECTION; MATCHING LAW; BEHAVIOR; REINFORCEMENT; MOLAR; EVOLUTION; ENTROPY;
D O I
10.3389/fpsyg.2021.684544
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Several authors have proposed that mechanisms of adaptive behavior, and reinforcement learning in particular, can be explained by an innate tendency of individuals to seek information about the local environment. In this article, I argue that these approaches adhere to an essentialist view of learning that avoids the question why information seeking should be favorable in the first place. I propose a selectionist account of adaptive behavior that explains why individuals behave as if they had a tendency to seek information without resorting to essentialist explanations. I develop my argument using a formal selectionist framework for adaptive behavior, the multilevel model of behavioral selection (MLBS). The MLBS has been introduced recently as a formal theory of behavioral selection that links reinforcement learning to natural selection within a single unified model. I show that the MLBS implies an average gain in information about the availability of reinforcement. Formally, this means that behavior reaches an equilibrium state, if and only if the Fisher information of the conditional probability of reinforcement is maximized. This coincides with a reduction in the randomness of the expected environmental feedback as captured by the information theoretic concept of expected surprise (i.e., entropy). The main result is that behavioral selection maximizes the information about the expected fitness consequences of behavior, which, in turn, minimizes average surprise. In contrast to existing attempts to link adaptive behavior to information theoretic concepts (e.g., the free energy principle), neither information gain nor surprise minimization is treated as a first principle. Instead, the result is formally deduced from the MLBS and therefore constitutes a mathematical property of the more general principle of behavioral selection. Thus, if reinforcement learning is understood as a selection process, there is no need to assume an active agent with an innate tendency to seek information or minimize surprise. Instead, information gain and surprise minimization emerge naturally because it lies in the very nature of selection to produce order from randomness.
引用
收藏
页数:12
相关论文
共 50 条
[41]   Synergy, redundancy, and multivariate information measures: an experimentalist's perspective [J].
Timme, Nicholas ;
Alford, Wesley ;
Flecker, Benjamin ;
Beggs, John M. .
JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2014, 36 (02) :119-140
[42]   Information Content Estimate of Model Proteomes: A Primary Structure Perspective [J].
Eroglu, Sertac .
CURRENT BIOINFORMATICS, 2017, 12 (06) :490-497
[43]   Why Cortical Neurons Cannot Divide, and Why Do They Usually Die in the Attempt? [J].
Aranda-Anzaldo, Armando ;
Dent, Myrna A. R. .
JOURNAL OF NEUROSCIENCE RESEARCH, 2017, 95 (04) :921-929
[44]   Why do antifreeze proteins require a solenoid? [J].
Banach, M. ;
Konieczny, L. ;
Roterman, I. .
BIOCHIMIE, 2018, 144 :74-84
[45]   An Evolutionary Perspective on Information Processing [J].
Trimmer, Peter C. ;
Houston, Alasdair I. .
TOPICS IN COGNITIVE SCIENCE, 2014, 6 (02) :312-330
[46]   Why are some people in the UK reluctant to seek support for their pets? [J].
Muldoon, Janine C. ;
Williams, Joanne M. .
ANIMAL WELFARE, 2024, 33
[47]   In Which Situations Do Adolescents Seek Parental Support and What Do They Need? [J].
de Jonge, Yanine B. ;
Nauta, Maaike H. ;
Bosmans, Guy .
JOURNAL OF CHILD AND FAMILY STUDIES, 2022, 31 (10) :2849-2859
[48]   What Help Do Developers Seek, When and How? [J].
Li, Hongwei ;
Xing, Zhenchang ;
Peng, Xin ;
Zhao, Wenyun .
2013 20TH WORKING CONFERENCE ON REVERSE ENGINEERING (WCRE), 2013, :142-151
[49]   Why Do Park Visitors Engage With Social Media for Peer-to-Peer Information? [J].
Sung, Billy ;
Lee, Sean ;
Kok, Keegan ;
Quintal, Vanessa ;
Chong, Athena Wei Chee .
LEISURE SCIENCES, 2024,
[50]   Why do narcissistic individuals engage in sex? Exploring sexual motives as a mediator for sexual satisfaction and function [J].
Gewirtz-Meydan, Ateret .
PERSONALITY AND INDIVIDUAL DIFFERENCES, 2017, 105 :7-13