Information Theory and Statistical Mechanics

  title={Information Theory and Statistical Mechanics},
  author={Edwin T. Jaynes},
  journal={Physical Review},
  • E. Jaynes
  • Published 15 October 1957
  • Mathematics
  • Physical Review
Treatment of the predictive aspect of statistical mechanics as a form of statistical inference is extended to the density-matrix formalism and applied to a discussion of the relation between irreversibility and information loss. A principle of "statistical complementarity" is pointed out, according to which the empirically verifiable probabilities of statistical mechanics necessarily correspond to incomplete predictions. A preliminary discussion is given of the second law of thermodynamics and… Expand

Figures from this paper

Irreversibility, Probability and Entropy
There is a single consistent resolution of the reversible microdynamicsirreversible maero dynamics problem, stemming from better understanding of the role of probability in physics: the BayesianExpand
Thermodynamics and Information Theory
The Laws of Classical Thermodynamics and the fundamental principles of Statistical Mechanics are reviewed with an emphasis on their logical structure. We discuss the universality of equilibriumExpand
Statistical Mechanics and the Maximum Entropy Method
This course reviews the foundations and methods of statistical mechanics in their relation to the maximum entropy principle. After having introduced the main tools of information theory and ofExpand
The Three Phases of Statistical Mechanics
The foundations of statistical mechanics are reviewed, based on the principle of maximum entropy, and this principle is shown to underlie the fundamental mechanisms of both equilibrium andExpand
An identity of Chernoff bounds with an interpretation in statistical physics and applications in information theory
  • N. Merhav
  • Mathematics, Computer Science
  • 2008 IEEE International Symposium on Information Theory
  • 2008
Several information-theoretic application examples are described, where the analysis of this large deviations rate function of the probability a certain rare event naturally arises, which results in several relationships between information theory and statistical physics. Expand
Entropic Formulation of Statistical Mechanics
We present an alternative formulation of Equilibrium Statistical Mechanics which follows the method based on the maximum statistical entropy principle in Information Theory combined with the use ofExpand
Maximum information entropy principle and the interpretation of probabilities in statistical mechanics − a short review
Abstract In this paper an alternative approach to statistical mechanics based on the maximum information entropy principle (MaxEnt) is examined, specifically its close relation with the Gibbs methodExpand
Foundations of statistical mechanics
Developments in the foundations of statistical mechanics during the past ten years or so. The author discusses how statistical concepts enter the treatment of deterministic mechanical systems, withExpand
Foundations of Statistical Mechanics: in and out of Equilibrium
The first part of the paper is devoted to the foundations, that is the mathematical and physical justification, of equilibrium statistical mechanics. It is a pedagogical attempt, mostly based onExpand
Statistical thermodynamics from the point of view of statistical theory of estimation
Abstract An essentially statistical theory of thermodynamics is developed on the basis of additivity and conservation laws of fundamental entities of thermodynamics. The theory developed by DuttaExpand