Formal grammar and information theory : together again ?

  title={Formal grammar and information theory : together again ?},
  author={Fernando Pereira},
In the last 40 years, research on models of spoken and written language has been split between two seemingly irreconcilable traditions: formal linguistics in the Chomsky tradition, and information theory in the Shannon tradition. Zellig Harris had advocated a close alliance between grammatical and information-theoretic principles in the analysis of natural language, and early formal-language theory provided another strong link between information theory and linguistics. Nevertheless, in most… CONTINUE READING
Highly Cited
This paper has 93 citations. REVIEW CITATIONS
60 Citations
52 References
Similar Papers


Publications citing this paper.

94 Citations

Citations per Year
Semantic Scholar estimates that this publication has 94 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 52 references

Extracting relevant bits: the information

  • N. 1253 Tishby, F. Pereira, W. Bialek
  • 1999
2 Excerpts

A type-logical perspective on minimalist derivations

  • T. Cornell
  • In Formal Grammar ’97 (ed. G.-J. van Kruij® & R…
  • 1997
3 Excerpts

Similar Papers

Loading similar papers…