Emergence of Zipf's Law in the Evolution of Communication

@article{CorominasMurtra2011EmergenceOZ,
  title={Emergence of Zipf's Law in the Evolution of Communication},
  author={Bernat Corominas-Murtra and Jordi Fortuny Andreu and Ricard V. Sol{\'e}},
  journal={Physical review. E, Statistical, nonlinear, and soft matter physics},
  year={2011},
  volume={83 3 Pt 2},
  pages={
          036115
        }
}
Zipf's law seems to be ubiquitous in human languages and appears to be a universal property of complex communicating systems. Following the early proposal made by Zipf concerning the presence of a tension between the efforts of speaker and hearer in a communication system, we introduce evolution by means of a variational approach to the problem based on Kullback's Minimum Discrimination of Information Principle. Therefore, using a formalism fully embedded in the framework of information theory… Expand
Optimization Models of Natural Communication
TLDR
Two important components of the family, namely the information theoretic principles and the energy function that combines them linearly, are reviewed from the perspective of psycholinguistics, language learning, information theory and synergetic linguistics. Expand
Zipf's Law in Human-Machine Dialog
TLDR
It is found that even though both the human and agent frequency distributions follow Zipf's law, these distributions are not necessarily similar, shed light on where agent dialog may distinguish itself from human dialog, and can serve as a way to monitor to what extent ubiquitous patterns in human-human dialog are found inhuman-machine dialog. Expand
On the Origin of Ambiguity in Efficient Communication
TLDR
The emergence of irreversible computations is required if the complexities of the coding and the decoding processes are balanced in a symmetric scenario, which means that the emergence of ambiguous codes is a necessary condition for natural communication to succeed. Expand
On ambiguity. Its locus in the architecture of Language and its origin in efficient communication
TLDR
This work locates ambiguity at the externalization branch of language, provides a rigorous, general definition of ambiguity through the concept of logical irreversibility, quantifying the amount of ambiguity within the framework of Shannon’s information theory. Expand
Large-Scale Analysis of Zipf’s Law in English Texts
TLDR
This work studies three different versions of Zipf’s law by fitting them to all available English texts in the Project Gutenberg database and finds one of them is able to fit more than 40% of thetexts in the database at the 0.05 significance level. Expand
Zipf’s Law, unbounded complexity and open-ended evolution
TLDR
It is concluded that statistical information (standard Shannon information) is not conserved, resulting in the paradoxical situation in which the increase of information content has the effect of erasing itself, and it is proved that this paradox is solved if the authors consider non-statistical forms of information. Expand
Luís F . Seoane Ambiguity in language networks
Human language defines the most complex outcomes of evolution. The emergence of such an elaborated form of communication allowed humans to create extremely structured societies and manage symbols atExpand
Statistical laws in linguistics
TLDR
It is argued that linguistic laws are only meaningful if accompanied by a model for which the fluctuations can be computed (e.g., a generative model of the text) and the constraints imposed by linguistic laws on the creativity process of text generation are not as tight as one could expect. Expand
Ambiguity in language networks
TLDR
Ambiguity is shown to play an essential role in providing a source of language efficiency, and is likely to be an inevitable byproduct of network growth. Expand
Analysis of an information-theoretic model for communication
We study the cost-minimization problem posed by Ferrer i Cancho and Sol\'e in their model of communication that aimed at explaining the origin of Zipf's law [PNAS 100, 788 (2003)]. Direct analysisExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 50 REFERENCES
Evolution of networks
TLDR
The recent rapid progress in the statistical physics of evolving networks is reviewed, and how growing networks self-organize into scale-free structures is discussed, and the role of the mechanism of preferential linking is investigated. Expand
Contemporary Physics
IT must, of course, be clearly understood that the following brief notes do not profess to mention, even by name, every important line of research in physics that is going on in the U.S.S.R.; theyExpand
Elements of Information Theory
TLDR
The author examines the role of entropy, inequality, and randomness in the design of codes and the construction of codes in the rapidly changing environment. Expand
Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems
TLDR
This ninth volume of the proceedings of the international A-life conference reflects the growing quality and impact of this interdisciplinary scientific community. Expand
Information Theory
Information TheoryPapers read at a Symposium on Information Theory held at the Royal Institution, London, August 29th to September 2nd, 1960. Edited by Colin Cherry. Pp. xi + 476. (London:Expand
Art
Descrizione sommaria dell’attività di ricerca: La/il candidata/o deve sviluppare ricerche nell’ambito della robotica sociale (sia Socially Assistive Robotics, sia Robots in Educational Contexts)Expand
Phys
  • Rev. E 82, 011102
  • 2010
Information Theory and Statistics (John Wiley and Sons
  • New York,
  • 1959
Information Theory and Statistics
  • E. Haroutunian
  • Mathematics, Computer Science
  • International Encyclopedia of Statistical Science
  • 2011
Lingua 77
  • 187 (1989). 036115-6 EMERGENCE OF ZIPF’s LAW IN THE EVOLUTION OF . . . PHYSICAL REVIEW E 83, 036115
  • 2011
...
1
2
3
4
5
...