Structural information in two-dimensional patterns: entropy convergence and excess entropy.

@article{Feldman2003StructuralII,
  title={Structural information in two-dimensional patterns: entropy convergence and excess entropy.},
  author={David P. Feldman and James P. Crutchfield},
  journal={Physical review. E, Statistical, nonlinear, and soft matter physics},
  year={2003},
  volume={67 5 Pt 1},
  pages={051104}
}
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging sequence of conditional entropies. We show that the manner in which these conditional entropies converge to their asymptotic value serves as a measure of global correlation and structure for spatial systems in any dimension. We compare and contrast entropy… CONTINUE READING