Compression and the origins of Zipf's law for word frequencies

@article{FerreriCancho2016CompressionAT,
  title={Compression and the origins of Zipf's law for word frequencies},
  author={Ramon Ferrer-i-Cancho},
  journal={Complexity},
  year={2016},
  volume={21},
  pages={409-411}
}
Here we sketch a new derivation of Zipf's law for word frequencies based on optimal coding. The structure of the derivation is reminiscent of Mandelbrot's random typing model but it has multiple advantages over random typing: (1) it departs from realistic cognitive pressures (2) it does not require fine tuning of parameters and (3) it sheds light on the origins of other statistical laws of language and thus can lead to a compact theory of linguistic laws. Our findings suggest that the… CONTINUE READING