Universal role of correlation entropy in critical phenomena

In statistical physics, if we divide successively an equilibrium system into two parts, we will face a situation that, to a certain length., the physics of a subsystem is no longer the same as the original one. The extensive property of the thermal entropy S(A boolean OR B) = S(A) + S(B) is then violated. This observation motivates us to introduce a concept of correlation entropy between two points, as measured by the mutual information in information theory, to study the critical phenomena. A rigorous relation is established to display some drastic features of the non-vanishing correlation entropy of a subsystem formed by any two distant particles with long-range correlation. This relation actually indicates a universal role played by the correlation entropy for understanding the critical phenomena. We also verify these analytical studies in terms of two well-studied models for both the thermal and quantum phase transitions: the two-dimensional Ising model and the one-dimensional transverse-field Ising model. Therefore, the correlation entropy provides us with a new physical intuition of the critical phenomena from the point of view of information theory.