Mutual Information Functions of Natural Language Texts

  title={Mutual Information Functions of Natural Language Texts},
  author={Wentian Li},
The mutual information function M(d), which is a quantity used to detect correlations in symbolic sequences, is applied to natural language texts. For some English and German texts being analyzed, M(d)’s for both the letter sequences and letter-type sequences exhibit approximate inverse power law function at shorter distance with exponents close to 3. This decay of M(d) is too fast to lead a 1/f power spectrum. Due to finite size effects, it is not conclusive as to whether the same inverse… CONTINUE READING

From This Paper

Topics from this paper.


Publications citing this paper.
Showing 1-10 of 12 extracted citations

Expansion-modification systems: A model for spatial 1/f spectra.

Physical review. A, Atomic, molecular, and optical physics • 1991
View 7 Excerpts
Highly Influenced


Publications referenced by this paper.
Showing 1-10 of 23 references

‘1/fnoise’ in music and speech

View 8 Excerpts
Highly Influenced

Rapid variability of 10-140 keV X-rays from Cygnus X-1

P. L. Nolan
The Astrophysical Journal 246, 494-501 (1981). • 1981
View 7 Excerpts
Highly Influenced

On the parallel between Zipf’s law and 1/f processes in chaotic systems possessing co-existing attractors — A possible mechanism for language formation in the cerebral cortex

John S. Nicolis, Ichiro Tsuda
Progress in Theoretical Physics 82(2) (1989). • 1989

Sporadicity: Between periodic and chaotic dynamical behaviors.

Proceedings of the National Academy of Sciences of the United States of America • 1988
View 1 Excerpt

Long-range Effects in an Elementary Cellular Automaton

Peter Grassberger
Journal of Statistical Physics 45 (1/2), 27-39 (1986). • 1986
View 1 Excerpt

A Progress Report on the Fine Art of Tuning Literature into Drivel

Brian Hayes
Computer Recreations, Scientific American 249(5), 18-28 (1983). • 1983
View 1 Excerpt

Similar Papers

Loading similar papers…