Information Entropy As a Basic Building Block of Complexity Theory

被引:53
作者
Gao, Jianbo [1 ,2 ,3 ]
Liu, Feiyan [4 ]
Zhang, Jianfang [4 ]
Hu, Jing [1 ,2 ,3 ]
Cao, Yinhe [3 ]
机构
[1] Guangxi Univ, Sch Mech Engn, Nanning 530005, Peoples R China
[2] Guangxi Univ, China Asean Res Inst, Nanning 530005, Peoples R China
[3] PMB Intelligence LLC, Sunnyvale, CA 94087 USA
[4] Univ Chinese Acad Sci, Sch Management, Beijing 100190, Peoples R China
关键词
information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis; LEMPEL-ZIV COMPLEXITY; NOISE; SYSTEMS; CHAOS;
D O I
10.3390/e15093396
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.
引用
收藏
页码:3396 / 3418
页数:23
相关论文
共 50 条
  • [41] Diagnostic Strategy Optimization Method Based on Information Entropy Theory
    Guo, Jiahao
    Shi, Xianjun
    Wang, Kang
    Qin, Yufeng
    2018 IEEE 4TH INTERNATIONAL CONFERENCE ON CONTROL SCIENCE AND SYSTEMS ENGINEERING (ICCSSE 2018), 2018, : 370 - 374
  • [42] A Hybrid Genetic Algorithm Based on Information Entropy and Game Theory
    Li Jiacheng
    Lei, Li
    IEEE ACCESS, 2020, 8 (08): : 36602 - 36611
  • [43] Detection and Localization of Multiple Damages through Entropy in Information Theory
    Ceravolo, Rosario
    Civera, Marco
    Lenticchia, Erica
    Miraglia, Gaetano
    Surace, Cecilia
    APPLIED SCIENCES-BASEL, 2021, 11 (13):
  • [44] Relative complexity measurement of a supply chain based on information theory
    Sellitto, Miguel Afonso
    Borchardt, Miriam
    Pereira, Giancarlo Medeiros
    Guimaraes, Marcelo Giovani
    IMCIC 2010: INTERNATIONAL MULTI-CONFERENCE ON COMPLEXITY, INFORMATICS AND CYBERNETICS, VOL I (POST-CONFERENCE EDITION), 2010, : 133 - 138
  • [45] Using Fuzzy Theory and Information Entropy to Detect Leakage for Pipelines
    Chen, Zhigang
    PROCEEDINGS OF THE 10TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA 2012), 2012, : 3232 - 3235
  • [46] Gaussian Guided Self-Adaptive Wolf Search Algorithm Based on Information Entropy Theory
    Song, Qun
    Fong, Simon
    Deb, Suash
    Hanne, Thomas
    ENTROPY, 2018, 20 (01):
  • [47] Information-Theory-Based Complexity Quantifier for Chaotic Semiconductor Laser With Double Time Delays
    Guo, Xing Xing
    Xiang, Shui Ying
    Zhang, Ya Hui
    Wen, Ai Jun
    Hao, Yue
    IEEE JOURNAL OF QUANTUM ELECTRONICS, 2018, 54 (01)
  • [48] Intelligent optimal layout of drainage pipe network monitoring points based on information entropy theory
    He, Min
    Zhang, Yibo
    Ma, Zhaoxi
    Zhao, Qin
    FRONTIERS IN ENVIRONMENTAL SCIENCE, 2024, 12
  • [49] Information Entropy and Mutual Information-based Uncertainty Measures in Rough Set Theory
    Sun, Lin
    Xu, Jiucheng
    APPLIED MATHEMATICS & INFORMATION SCIENCES, 2014, 8 (04): : 1973 - 1985
  • [50] Nonlinearity of the non-Abelian lattice gauge field theory according to the spectrum of Kolmogorov-Sinai entropy and complexity
    Fulop, Agnes
    ACTA UNIVERSITATIS SAPIENTIAE INFORMATICA, 2021, 13 (02) : 373 - 400