# Model-order selection: a review of information criterion rules

@article{Stoica2004ModelorderSA, title={Model-order selection: a review of information criterion rules}, author={Petre Stoica and Yngve Sel{\'e}n}, journal={IEEE Signal Processing Magazine}, year={2004}, volume={21}, pages={36-47} }

The parametric (or model-based) methods of signal processing often require not only the estimation of a vector of real-valued parameters but also the selection of one or several integer-valued parameters that are equally important for the specification of a data model. Examples of these integer-valued parameters of the model include the orders of an autoregressive moving average model, the number of sinusoidal components in a sinusoids-in-noise signal, and the number of source signals impinging…

## 917 Citations

### The Monte-Carlo Sampling Approach to Model Selection: A Primer [Lecture Notes]

- Computer ScienceIEEE Signal Processing Magazine
- 2022

This lecture note introduces several Monte-Carlo sampling-based rules for model selection using the maximum a posteriori (MAP) approach for signal processing applications.

### Model selection and comparison for independents sinusoids

- Computer Science, Mathematics2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- 2014

Through simulations, it is demonstrated that the lp-BIC outperforms the asymptotic MAP criterion and other state of the art methods in terms of model selection, de-noising and prediction performance.

### Signals detection using short-time correlation and autoregressive modeling

- Computer Science
- 2007

The analysis of the signal as dynamic invariant in respect of the linear shift transformation yields the function of model consistency, which enables to detect short-time and nonstationary wave packets at signal to noise ratio as from -20 dB and above.

### Estimating the number of signals with unknown parameters under Gaussian noises

- Computer Science2022 International Telecommunications Conference (ITC-Egypt)
- 2022

A class of signal parameters for which the widely used maximum likelihood method is useless for estimating the number of signals is described, and it is established, that the amplitude parameters belong to this class.

### Parameter estimation of exponential signals: A system identification approach

- MathematicsDigit. Signal Process.
- 2013

### Aalborg Universitet Model selection and comparison for independents sinusoids

- Computer Science
- 2014

Through simulations, it is demonstrated that the lp-BIC outperforms the asymptotic MAP criterion and other state of the art methods in terms of model selection, de-noising and prediction performance.

### A comparative study of model selection criteria for the number of signals

- Computer Science
- 2008

The authors show that, in simple MUSIC additive white noise model, for small sample size n, WIC performs nearly as well as AlCc and outperforms other criteria, and for moderately large to large n, the authors suggest that WIC may be a practical alternative to any criterion.

### Identification of autoregressive moving average systems based on noise compensation in the correlation domain

- Engineering
- 2011

This study presents a new scheme for the identification of minimum-phase autoregressive moving average (ARMA) systems from noise-corrupted observations. From the autocorrelation function (ACF) of the…

### New approach to model‐order selection

- MathematicsElectronics Letters
- 2020

ELECT A new, direct and practical scheme is proposed for determining the model orders of a system, its signal and disturbance using key properties of Kalman filter (KF). Unlike conventional methods,…

### M-estimator-based robust estimation of the number of components of a superimposed sinusoidal signal model

- Computer Science
- 2014

The proposed methods, which are robust modifications of the commonly used information theoretic criteria, are based on various M-estimator approaches and are robust with respect to outliers present in the data and heavy-tailed noise.

## References

SHOWING 1-10 OF 41 REFERENCES

### Finite sample criteria for autoregressive order selection

- MathematicsIEEE Trans. Signal Process.
- 2000

The special finite sample information criterion and combined information criterion are necessary because of the increase of the variance of the residual energy for higher model orders that has not been accounted for in other criteria.

### Order selection for vector autoregressive models

- Computer ScienceIEEE Trans. Signal Process.
- 2003

Order-selection criteria for vector autoregressive (AR) modeling are discussed and the combined information criterion (CIC) for vector signals is robust to finite sample effects and has the optimal asymptotic penalty factor.

### Automatic spectral analysis with time series models

- Computer ScienceIEEE Trans. Instrum. Meas.
- 2002

The increased computational speed and developments in the robustness of algorithms have created the possibility to identify automatically a well-fitting time series model for stochastic data that includes precisely the statistically significant details that are present in the data.

### On the Likelihood of a Time Series Model

- Computer Science
- 1978

By asking the log likelihood of a model to be an unbiased estimate of the expectedlog likelihood of the model, a reasonable definition of the likelihood is obtained and this allows us to develop a systematic approach to parametric time series modelling.

### Exact and Large Sample ML Techniques for Parameter Estimation and Detection in Array Processing

- Computer Science
- 1993

A vast number of algorithms has appeared in the literature for estimating unknown signal parameters from the measured output of a sensor array based on measurements of the array output.

### Arma Model Identification

- Mathematics
- 1992

During the past two decades, considerable progress has been made in statistical time series analysis. The aim of this book is to present a survey of one of the most active areas in this field: the…

### A new look at the statistical model identification

- Mathematics
- 1974

The history of the development of statistical hypothesis testing in time series analysis is reviewed briefly and it is pointed out that the hypothesis testing procedure is not adequately defined as…

### The statistical theory of linear systems

- Mathematics
- 1988

Publisher Summary The chapter discusses the development of a rather complete inferential theory for ARMAX models. The first problem in the development is the coordinatization of spaces of such…

### Some properties of the order of an autoregressive model selected by a generalization of Akaike∘s EPF criterion

- Mathematics
- 1977

SUMMARY The asymptotic distribution of the order of an autoregression selected by a generalization of Akaike's FPE criterion is given. Some of the properties of the distribution are investigated. The…