Information Entropy As a Basic Building Block of Complexity Theory

被引:53
作者
Gao, Jianbo [1 ,2 ,3 ]
Liu, Feiyan [4 ]
Zhang, Jianfang [4 ]
Hu, Jing [1 ,2 ,3 ]
Cao, Yinhe [3 ]
机构
[1] Guangxi Univ, Sch Mech Engn, Nanning 530005, Peoples R China
[2] Guangxi Univ, China Asean Res Inst, Nanning 530005, Peoples R China
[3] PMB Intelligence LLC, Sunnyvale, CA 94087 USA
[4] Univ Chinese Acad Sci, Sch Management, Beijing 100190, Peoples R China
关键词
information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis; LEMPEL-ZIV COMPLEXITY; NOISE; SYSTEMS; CHAOS;
D O I
10.3390/e15093396
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.
引用
收藏
页码:3396 / 3418
页数:23
相关论文
共 50 条
  • [31] Analysis of Shannon-Fisher information plane in time series based on information entropy
    Wang, Yuanyuan
    Shang, Pengjian
    CHAOS, 2018, 28 (10)
  • [32] Estimation of Complexity of Sampled Biomedical Continuous Time Signals Using Approximate Entropy
    Mesin, Luca
    FRONTIERS IN PHYSIOLOGY, 2018, 9
  • [33] New mathematical measures for apprehending complexity of chiral molecules using information entropy
    Piras, Patrick
    CHIRALITY, 2022, 34 (04) : 646 - 666
  • [34] Wigner separability entropy and complexity of quantum dynamics
    Benenti, Giuliano
    Carlo, Gabriel G.
    Prosen, Tomaz
    PHYSICAL REVIEW E, 2012, 85 (05):
  • [35] APPROXIMATE ENTROPY AS A MEASURE OF SYSTEM-COMPLEXITY
    PINCUS, SM
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1991, 88 (06) : 2297 - 2301
  • [36] Dispersive graded entropy on computing dynamical complexity
    Mukherjee, Sayan
    Banerjee, Santo
    Rondoni, Lamberto
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 508 : 131 - 140
  • [37] Complexity Theory in Biology and Technology: Broken Symmetries and Emergence
    Ellis, George F. R.
    Di Sia, Paolo
    SYMMETRY-BASEL, 2023, 15 (10):
  • [38] Building Better Ecological Machines: Complexity Theory and Alternative Economic Models
    Bier, Jess
    Schinkel, Willem
    ENGAGING SCIENCE TECHNOLOGY AND SOCIETY, 2016, 2 : 266 - 293
  • [39] An improvement on measure methods of the complexity theory and its applications
    Wang Fu-Lai
    Yang Hui-Huang
    CHINESE PHYSICS B, 2009, 18 (09) : 4042 - 4048
  • [40] An improvement on measure methods of the complexity theory and its applications
    王福来
    杨辉煌
    Chinese Physics B, 2009, (09) : 4042 - 4048