Parameter estimation for power-law distributions by maximum likelihood methods

  title={Parameter estimation for power-law distributions 
 by maximum likelihood methods},
  author={Heiko Bauke},
  journal={The European Physical Journal B},
  • H. Bauke
  • Published 14 April 2007
  • Mathematics
  • The European Physical Journal B
Abstract.Distributions following a power-law are an ubiquitous phenomenon. Methods for determining the exponent of a power-law tail by graphical means are often used in practice but are intrinsically unreliable. Maximum likelihood estimators for the exponent are a mathematically sound alternative to graphical methods.  

Figures and Tables from this paper

Fixing Bias in Zipf's Law Estimators Using Approximate Bayesian Computation
A more computationally efficient method of approximate Bayesian computation is described that estimates Zipf exponents for large datasets without bias.
Maximum Likelihood Estimation of Band-Limited Power Law Spectrums
  • B. Rigling
  • Mathematics
    IEEE Signal Processing Letters
  • 2012
An empirical study illustrates that the maximum likelihood estimator outperforms traditional Fourier transform based estimators, and achieves the Cramér-Rao bound.
Power-Law Distributions in Empirical Data
This work proposes a principled statistical framework for discerning and quantifying power-law behavior in empirical data by combining maximum-likelihood fitting methods with goodness-of-fit tests based on the Kolmogorov-Smirnov (KS) statistic and likelihood ratios.
Maximum Likelihood Estimation of Power-law Degree Distributions via Friendship Paradox-based Sampling
This paper presents a novel maximum likelihood estimation approach that exploits the friendship paradox to sample more efficiently from the tail of the degree distribution and results in a smaller bias, variance and a Cramer-Rao lower bound compared to the maximum-likelihood estimate obtained with uniformly sampled nodes.
Non-parametric power-law surrogates
Power-law distributions are essential in computational and statistical investigations of extreme events and complex systems. The usual technique to generate power-law distributed data is to first
Fitting power-laws in empirical data with estimators that work for all exponents
This work first derives the appropriate ML estimator for arbitrary exponents of power-law distributions on bounded discrete sample spaces, and shows that an almost identical estimator also works perfectly for continuous data.
Maximum likelihood estimators for truncated and censored power-law distributions show how neuronal avalanches may be misevaluated.
An alternative series of maximum likelihood estimators for discrete, continuous, bounded, and censored data are developed and it is shown that these estimators lead to accurate evaluations of power-law distributions, improving on common approaches.
Penalized KS method to fit data sets with power law distribution over a bounded subinterval
It is shown through simulation studies that an adaptively penalized Kolmogorov-Smirnov (apKS) method improves the estimation of the power law interval on random samples from various theoretical probability distributions.


Problems with fitting to the power-law distribution
Abstract.This short communication uses a simple experiment to show that fitting to a power law distribution by using graphical methods based on linear fit on the log-log scale is biased and
How to make a Hill Plot
An abundance of high quality data sets requiring heavy tailed models necessitates reliable methods of estimating the shape parameter governing the degree of tail heaviness. The Hill estimator is a
Introduction to Probability and Mathematical Statistics
Probability Random Variables and Their Distributions Special Probability Distributions Joint Distributions Properties of Random Variables Functions of Random Variables Limiting Distributions
In all likelihood : statistical modelling and inference using likelihood
This paper presents a meta-modelling framework for estimating the likelihood of random parameters in a discrete-time environment and describes its use in simple and complex models.
Power laws, Pareto distributions and Zipf's law
Some of the empirical evidence for the existence of power-law forms and the theories proposed to explain them are reviewed.
The statistical sleuth : a course in methods of data analysis
1. Drawing Statistical Conclusions. 2. Inference Using t-Distributions. 3. A Closer Look at Assumptions. 4. Alternatives to the t-Tools. 5. Comparisons among Several Samples. 6. Linear Combinations
Revisiting "scale-free" networks.
  • E. Keller
  • Computer Science
    BioEssays : news and reviews in molecular, cellular and developmental biology
  • 2005
The real surprise, if any, is that power-law distributions are easy to generate, and by a variety of mechanisms; the architecture that results is not universal, but particular; it is determined by the actual constraints on the system in question.
A preferential attachment model with Poisson growth for scale-free networks
A scale-free network model with a tunable power-law exponent that can generate any network is proposed, motivated by an application in Bayesian inference implemented as Markov chain Monte Carlo to estimate a network.
The European Phys ical Journal B41(2)
  • 255
  • 2004
  • 1060
  • 2005