# Randomness versus specifics for word-frequency distributions

@article{Yan2016RandomnessVS, title={Randomness versus specifics for word-frequency distributions}, author={Xiao-Yong Yan and P. Minnhagen}, journal={Physica A-statistical Mechanics and Its Applications}, year={2016}, volume={444}, pages={828-837} }

The text-length-dependence of real word-frequency distributions can be connected to the general properties of a random book. It is pointed out that this finding has strong implications, when deciding between two conceptually different views on word-frequency distributions, i.e. the specific ‘Zipf’s-view’ and the non-specific ‘Randomness-view’, as is discussed. It is also noticed that the text-length transformation of a random book does have an exact scaling property precisely for the power-law… Expand

#### 10 Citations

Dependence of exponents on text length versus finite-size scaling for word-frequency distributions.

- Medicine, Mathematics
- Physical review. E
- 2017

Two Universality Properties Associated with the Monkey Model of Zipf's Law

- Mathematics, Computer Science
- Entropy
- 2016

Probability distribution of intersymbol distances in random symbolic sequences: Applications to improving detection of keywords in texts and of amino acid clustering in proteins.

- Mathematics, Medicine
- Physical review. E
- 2016

The Dependence of Frequency Distributions on Multiple Meanings of Words, Codes and Signs

- Mathematics, Computer Science
- ArXiv
- 2017

Assessing sustainability performance of high-tech firms through a hybrid approach

- Business, Computer Science
- Ind. Manag. Data Syst.
- 2019

#### References

SHOWING 1-10 OF 30 REFERENCES

Size dependent word frequencies and translational invariance of books

- Mathematics, Computer Science
- ArXiv
- 2009

Maximum Entropy, Word-Frequency, Chinese Characters, and Multiple Meanings

- Physics, Computer Science
- PloS one
- 2015

Random texts exhibit Zipf's-law-like word frequency distribution

- Mathematics, Computer Science
- IEEE Trans. Inf. Theory
- 1992

Deviation of Zipf's and Heaps' Laws in Human Languages with Limited Dictionary Sizes

- Computer Science, Medicine
- Scientific reports
- 2013

Languages cool as they expand: Allometric scaling and the decreasing need for new words

- Computer Science, Medicine
- Scientific reports
- 2012

Least effort and the origins of scaling in human language

- Computer Science, Medicine
- Proceedings of the National Academy of Sciences of the United States of America
- 2003

Dynamics of Text Generation with Realistic Zipf's Distribution

- Computer Science, Physics
- J. Quant. Linguistics
- 2005

Language as an evolving word web

- Computer Science, Medicine
- Proceedings of the Royal Society of London. Series B: Biological Sciences
- 2001