Determination of relevancy and redundancy of the parameters of information theory

被引:6
|
作者
Matherny, M [1 ]
Eckschlager, K [1 ]
机构
[1] CHARLES UNIV,INST INORGAN CHEM,CR-12800 PRAGUE 8,CZECH REPUBLIC
关键词
information theory; multi-component analysis; spectral analysis; relevancy; redundancy;
D O I
10.1016/0169-7439(95)00066-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Relevancy and redundancy values of the analytical results can, in principle, be expressed by means of the information theory parameters, mainly on the basis of calculated values of information contents or measure of information content. Variations in the calculated values of information contents of the experimental results with respect to the tolerance values numerically express the information profits and their redundancy. The relevancy coefficient acts always as a reducing parameter of the values of information contents but express also the degree of usefulness of the actual analytical determination.
引用
收藏
页码:67 / 72
页数:6
相关论文
共 50 条
  • [1] A Rigorous Information-Theoretic Definition of Redundancy and Relevancy in Feature Selection Based on (Partial) Information Decomposition
    Wollstadt, Patricia
    Schmitt, Sebastian
    Wibral, Michael
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [2] Feature Selection Method for Nonintrusive Load Monitoring With Balanced Redundancy and Relevancy
    Bao, Sheng
    Zhang, Li
    Han, Xueshan
    Li, Wensheng
    Sun, Donglei
    Ren, Yijing
    Liu, Ningning
    Yang, Ming
    Zhang, Boyi
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2022, 58 (01) : 163 - 172
  • [3] Overcoming Confounding Bias in Causal Discovery Using Minimum Redundancy and Maximum Relevancy Constraint
    Nadendla, Havisha
    Etha, Pujit Pavan
    Chowriappa, Pradeep
    IEEE ACCESS, 2024, 12 : 33057 - 33068
  • [4] Dependency and Redundancy: How Information Theory Untangles Three Variable Interactions in Environmental Data
    Weijs, S. V.
    Foroozand, H.
    Kumar, A.
    WATER RESOURCES RESEARCH, 2018, 54 (10) : 7143 - 7148
  • [5] Information and redundancy in the legend of Theseus
    Warner, J
    JOURNAL OF DOCUMENTATION, 2003, 59 (05) : 540 - 557
  • [6] Information Theory-Based Feature Selection: Minimum Distribution Similarity with Removed Redundancy
    Zhang, Yu
    Lin, Zhuoyi
    Kwoh, Chee Keong
    COMPUTATIONAL SCIENCE - ICCS 2020, PT V, 2020, 12141 : 3 - 17
  • [7] Unsupervised Feature Selection Based on Spectral Clustering with Maximum Relevancy and Minimum Redundancy Approach
    Khozaei, Bahareh
    Eftekhari, Mahdi
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (11)
  • [8] The Identity of Information: How Deterministic Dependencies Constrain Information Synergy and Redundancy
    Chicharro, Daniel
    Pica, Giuseppe
    Panzeri, Stefano
    ENTROPY, 2018, 20 (03)
  • [9] Synergy and Redundancy in Dual Decompositions of Mutual Information Gain and Information Loss
    Chicharro, Daniel
    Panzeri, Stefano
    ENTROPY, 2017, 19 (02)
  • [10] Measuring the Balance Between Synergy and Redundancy in Network Systems by Using Information Theory
    Antonacci, Yuri
    Mijatovic, Gorana
    Sparacino, Laura
    Valenti, Simone
    Sparacia, Gianvincenzo
    Marinazzo, Daniele
    Stramaglia, Sebastiano
    Faes, Luca
    MEDICON 2023 AND CMBEBIH 2023, VOL 1, 2024, 93 : 145 - 154