The variation of Zipf's law in human language
@article{Cancho2005TheVO, title={The variation of Zipf's law in human language}, author={Ramon Ferrer i Cancho}, journal={European Physical Journal B}, year={2005}, volume={44}, pages={249-257} }
Words in humans follow the so-called Zipf’s law. More precisely, the word frequency spectrum follows a power function, whose typical exponent is β≈2, but significant variations are found. We hypothesize that the full range of variation reflects our ability to balance the goal of communication, i.e. maximizing the information transfer and the cost of communication, imposed by the limitations of the human brain. We show that the higher the importance of satisfying the goal of communication, the…
88 Citations
Zipf's law from a communicative phase transition
- Computer Science
- 2005
It is supported that Zipf's law in a communication system may maximize the information transfer under constraints and be specially suitable for the speech of schizophrenics.
Hidden communication aspects in the exponent of Zipf's law
- Computer ScienceGlottometrics
- 2005
The exponent of Zipf’s law is shown to be a key aspect for knowing about the number of stimuli handled by a communication system, and determining which of two systems is less vague or less expensive.
Reply to "Comment on 'A Scaling law beyond Zipf's law and its relation to Heaps' law'"
- Physics
- 2013
The dependence on text length of the statistical properties of word occurrences has long been considered a severe limitation on the usefulness of quantitative linguistics. We propose a simple scaling…
The origins of Zipf's meaning‐frequency law
- PsychologyJ. Assoc. Inf. Sci. Technol.
- 2018
It is shown that a single assumption on the joint probability of a word and a meaning suffices to infer Zipf's meaning‐frequency law or relaxed versions, and can be justified as the outcome of a biased random walk in the process of mental exploration.
A decentralized route to the origins of scaling in human language
- MathematicsJournal of Statistical Mechanics: Theory and Experiment
- 2019
The appearance of an intermediate distribution of frequencies at some critical values of the parameter suggests that on a population of artificial agents the emergence of scaling partly arises as a self-organized process only from local interactions between agents.
Zipf’s laws of meaning in Catalan
- LinguisticsPloS one
- 2021
The first study of Zipfian laws relating the frequency of a word with its number of meanings in Catalan is presented, verified via the relationship among their exponents and that of the rank-frequency law.
Zipf's law revisited: Spoken dialog, linguistic units, parameters, and the principle of least effort.
- LinguisticsPsychonomic bulletin & review
- 2022
The ubiquitous inverse relationship between word frequency and word rank is commonly known as Zipf's law. The theoretical underpinning of this law states that the inverse relationship yields…
A Probabilistic Model of Systems Exhibiting Zipf ’ s Law Behavior
- Computer Science
- 2008
Zipf’s law is a psychological law about the distribution of word frequencies in a language. It states the number of words with a given frequency, f, is inversely proportional to that frequency. That…
Can simple models explain Zipf's law for all exponents?
- PhysicsGlottometrics
- 2005
There is no single radically simple explanation covering the whole range of variation of the exponent of Zipf’s law in humans, so two similar generalizations of Simon's model are introduced that cover the same range of exponents as the standard Simon model.
Phase transitions in a decentralized graph-based approach to human language
- Computer SciencePhysical review. E
- 2021
The aim here is double: within a bipartite-graph approach to human vocabularies, to propose a decentralized language game model for the formation of Zipfian properties and to define a language game in which a population of artificial agents is involved in idealized linguistic interactions.
References
SHOWING 1-10 OF 70 REFERENCES
Least effort and the origins of scaling in human language
- PhysicsProceedings of the National Academy of Sciences of the United States of America
- 2003
This article explains how language evolution can take advantage of a communicative phase transition and suggests that Zipf's law is a hallmark of symbolic reference and not a meaningless feature.
Two Regimes in the Frequency of Words and the Origins of Complex Lexicons: Zipf’s Law Revisited*
- PhysicsJ. Quant. Linguistics
- 2001
It is made evident that word frequency as a function of the rank follows two different exponents, ˜(-)1 for the first regime and ™(-)2 for the second.
Quantitative Linguistics and Complex System Studies
- Computer ScienceJ. Quant. Linguistics
- 1996
Linguistic discourses treated as maximum entropy systems of words according to prescriptions of algorithmic information theory are shown to give a natural explanation of Zipf's law with quantitative rigor and are likely to be valid for diverse complex systems of nature.
The evolution of syntactic communication
- LinguisticsNature
- 2000
A model for the population dynamics of language evolution is presented, the basic reproductive ratio of words and the maximum size of a lexicon are defined and the number of required signals exceeds a threshold value is calculated.
The basic reproductive ratio of a word, the maximum size of a lexicon.
- LinguisticsJournal of theoretical biology
- 2000
A mathematical framework is constructed for the population dynamics of language evolution with particular emphasis on how words are propagated over generations, and an upper limit is obtained for the number of words in a language that relies exclusively on oral transmission.
Major Transitions in Language Evolution
- Computer ScienceEntropy
- 2001
This paper uses mathematical models to analyzethe major transitions in language evolution and discusses the evolution ofcoordinated associations between signals and objects in a population, and analyzes the population dynamics of words and the adaptive emergence of syntax.