Information Theory and Statistical Mechanics
@article{Jaynes1957InformationTA,
title={Information Theory and Statistical Mechanics},
author={Edwin T. Jaynes},
journal={Physical Review},
year={1957},
volume={106},
pages={620-630}
}Treatment of the predictive aspect of statistical mechanics as a form of statistical inference is extended to the density-matrix formalism and applied to a discussion of the relation between irreversibility and information loss. A principle of "statistical complementarity" is pointed out, according to which the empirically verifiable probabilities of statistical mechanics necessarily correspond to incomplete predictions. A preliminary discussion is given of the second law of thermodynamics and… Expand
10,685 Citations
Irreversibility, Probability and Entropy
- Mathematics
- 1994
There is a single consistent resolution of the reversible microdynamicsirreversible maero dynamics problem, stemming from better understanding of the role of probability in physics: the Bayesian… Expand
Thermodynamics and Information Theory
- 2018
The Laws of Classical Thermodynamics and the fundamental principles of Statistical Mechanics are reviewed with an emphasis on their logical structure. We discuss the universality of equilibrium… Expand
Statistical Mechanics and the Maximum Entropy Method
- Mathematics
- 1994
This course reviews the foundations and methods of statistical mechanics in their relation to the maximum entropy principle. After having introduced the main tools of information theory and of… Expand
The Three Phases of Statistical Mechanics
- Physics
- 1989
The foundations of statistical mechanics are reviewed, based on the principle of maximum entropy, and this principle is shown to underlie the fundamental mechanisms of both equilibrium and… Expand
An identity of Chernoff bounds with an interpretation in statistical physics and applications in information theory
- Mathematics, Computer Science
- 2008 IEEE International Symposium on Information Theory
- 2008
Several information-theoretic application examples are described, where the analysis of this large deviations rate function of the probability a certain rare event naturally arises, which results in several relationships between information theory and statistical physics. Expand
Entropic Formulation of Statistical Mechanics
- Mathematics
- 2002
We present an alternative formulation of Equilibrium Statistical Mechanics which follows the method based on the maximum statistical entropy principle in Information Theory combined with the use of… Expand
Maximum information entropy principle and the interpretation of probabilities in statistical mechanics − a short review
- Mathematics, Physics
- 2016
Abstract
In this paper an alternative approach to statistical mechanics based on the maximum
information entropy principle (MaxEnt) is examined, specifically its close relation with
the Gibbs method… Expand
Foundations of statistical mechanics
- Physics
- 1969
Developments in the foundations of statistical mechanics during the past ten years or so. The author discusses how statistical concepts enter the treatment of deterministic mechanical systems, with… Expand
Foundations of Statistical Mechanics: in and out of Equilibrium
- Physics, Mathematics
- 2005
The first part of the paper is devoted to the foundations, that is the mathematical and physical justification, of equilibrium statistical mechanics. It is a pedagogical attempt, mostly based on… Expand
Statistical thermodynamics from the point of view of statistical theory of estimation
- Mathematics
- 1978
Abstract An essentially statistical theory of thermodynamics is developed on the basis of additivity and conservation laws of fundamental entities of thermodynamics. The theory developed by Dutta… Expand