Approximating Kolmogorov complexity

被引:1
|
作者
Ishkuvatov, Ruslan [1 ]
Musatov, Daniil [2 ]
Shen, Alexander [1 ]
机构
[1] Univ Montpellier, CNRS, LIRMM, Montpellier, France
[2] Moscow Inst Phys & Technol, Phystech Sch Appl Math & Comp Sci, Dolgoprudnyi, Russia
来源
COMPUTABILITY-THE JOURNAL OF THE ASSOCIATION CIE | 2023年 / 12卷 / 03期
关键词
Kolmogorov complexity; generic computability; coarse computability; approximation; mass problems; COMPUTABILITY;
D O I
10.3233/COM-200302
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
It is well known that the Kolmogorov complexity function (the minimal length of a program producing a given string, when an optimal programming language is used) is not computable and, moreover, does not have computable lower bounds. In this paper we investigate a more general question: can this function be approximated? By approximation we mean two things: firstly, some (small) difference between the values of the complexity function and its approximation is allowed; secondly, at some (rare) points the values of the approximating function may be arbitrary. For some values of the parameters such approximation is trivial (e.g., the length function is an approximation with error d except for a O(2 (d)) fraction of inputs). However, if we require a significantly better approximation, the approximation problem becomes hard, and we prove it in several settings. Firstly, we show that a finite table that provides good approximations for Kolmogorov complexities of n-bit strings, necessarily has high complexity. Secondly, we show that there is no good computable approximation for Kolmogorov complexity of all strings. In particular, Kolmogorov complexity function is neither generically nor coarsely computable, as well as its approximations, and the time-bounded Kolmogorov complexity (for any computable time bound) deviates significantly from the unbounded complexity function. We also prove hardness of Kolmogorov complexity approximation in another setting: the mass problem whose solutions are good approximations for Kolmogorov complexity function is above the halting problem in the Medvedev lattice. Finally, we mention some proof-theoretic counterparts of these results. A preliminary version of this paper was presented at CiE 2019 conference (In Computing with Foresight and Industry - 15th Conference on Computability in Europe, CiE 2019, Durham, UK, July 15-19, 2019, Proceedings (2019) 230-239 Springer).
引用
收藏
页码:283 / 297
页数:15
相关论文
共 50 条
  • [1] An Additively Optimal Interpreter for Approximating Kolmogorov Prefix Complexity
    Leyva-Acosta, Zoe
    Yeomans, Eduardo Acuna
    Hernandez-Quiroz, Francisco
    ENTROPY, 2024, 26 (09)
  • [2] On the Formalisation of Kolmogorov Complexity
    Catt, Elliot
    Norrish, Michael
    CPP '21: PROCEEDINGS OF THE 10TH ACM SIGPLAN INTERNATIONAL CONFERENCE ON CERTIFIED PROGRAMS AND PROOFS, 2021, : 291 - 299
  • [3] Kolmogorov-Loveland Stochasticity and Kolmogorov Complexity
    Bienvenu, Laurent
    THEORY OF COMPUTING SYSTEMS, 2010, 46 (03) : 598 - 617
  • [4] Kolmogorov-Loveland Stochasticity and Kolmogorov Complexity
    Laurent Bienvenu
    Theory of Computing Systems, 2010, 46 : 598 - 617
  • [5] Kolmogorov complexity and noncomputability
    Davie, G
    MATHEMATICAL LOGIC QUARTERLY, 2002, 48 (04) : 574 - 580
  • [6] Kolmogorov complexity of categories
    Department of Computer and Information Science, Brooklyn College, CUNY, Brooklyn, NY 11210, United States
    不详
    Lect. Notes Comput. Sci., 2013, (350-362): : 350 - 362
  • [7] Kolmogorov complexity and cryptography
    Muchnik, Andrej A.
    PROCEEDINGS OF THE STEKLOV INSTITUTE OF MATHEMATICS, 2011, 274 (01) : 193 - 203
  • [8] Axiomatizing Kolmogorov Complexity
    Antoine Taveneaux
    Theory of Computing Systems, 2013, 52 : 148 - 161
  • [9] Kolmogorov complexity and cryptography
    Andrej A. Muchnik
    Proceedings of the Steklov Institute of Mathematics, 2011, 274 : 193 - 203
  • [10] Axiomatizing Kolmogorov Complexity
    Taveneaux, Antoine
    THEORY OF COMPUTING SYSTEMS, 2013, 52 (01) : 148 - 161