Exponentially embedded families - new approaches to model order estimation

@article{Kay2005ExponentiallyEF,
  title={Exponentially embedded families - new approaches to model order estimation},
  author={S. Kay},
  journal={IEEE Transactions on Aerospace and Electronic Systems},
  year={2005},
  volume={41},
  pages={333-345}
}
  • S. Kay
  • Published 2005
  • Mathematics
  • IEEE Transactions on Aerospace and Electronic Systems
  • The use of exponential embedding of two or more probability density functions (pdfs) is introduced. Termed the exponentially embedded family (EEF) of pdfs, its properties are first examined and then it is applied to the problem of model order estimation. The proposed estimator is compared with the minimum description length (MDL) and is found to be superior for cases of practical interest. Also, we point out there is a relationship between the embedded family model order estimator and the… CONTINUE READING
    97 Citations

    Figures from this paper.

    A Geometrical Interpretation of Exponentially Embedded Families of Gaussian Probability Density Functions for Model Selection
    • 2
    On the Exponentially Embedded Family (EEF) Rule for Model Order Selection
    • P. Stoica, P. Babu
    • Mathematics, Computer Science
    • IEEE Signal Processing Letters
    • 2012
    • 13
    • Highly Influenced
    High-SNR model order selection using exponentially embedded family and its applications to curve fitting and clustering
    • Q. Ding, S. Kay, X. Zhang
    • Mathematics, Computer Science
    • 2014 IEEE Symposium on Computational Intelligence and Data Mining (CIDM)
    • 2014
    • 2
    The penalty term of Exponentially Embedded Family is estimated mutual information
    • Zhenghan Zhu, S. Kay
    • Mathematics, Computer Science
    • 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • 2017
    • 2
    • Highly Influenced
    • PDF
    Exponentially embedded families for multimodal sensor processing
    • S. Kay, Q. Ding
    • Mathematics, Computer Science
    • 2010 IEEE International Conference on Acoustics, Speech and Signal Processing
    • 2010
    • 14
    • PDF
    Probability Density Function Estimation Using the EEF With Application to Subset/Feature Selection
    • 17
    A Parametric Classification Rule Based on the Exponentially Embedded Family
    • 24
    • PDF
    Model Estimation and Classification Via Model Structure Determination
    • S. Kay, Q. Ding
    • Mathematics, Computer Science
    • IEEE Transactions on Signal Processing
    • 2013
    • 4
    On Bayesian Exponentially Embedded Family for Model Order Selection
    • Zhenghan Zhu, S. Kay
    • Computer Science, Mathematics
    • IEEE Transactions on Signal Processing
    • 2018
    • 10
    • Highly Influenced
    • PDF
    Estimating the order of multiple sinusoids model using exponentially embedded family rule: Large sample consistency
    • 1
    • Highly Influenced

    References

    SHOWING 1-10 OF 22 REFERENCES
    Conditional model order estimation
    • S. Kay
    • Computer Science, Mathematics
    • IEEE Trans. Signal Process.
    • 2001
    • 47
    • PDF
    Asymptotic MAP criteria for model selection
    • P. Djurić
    • Mathematics, Computer Science
    • IEEE Trans. Signal Process.
    • 1998
    • 147
    • PDF
    Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models
    • R. Kashyap
    • Computer Science, Medicine
    • IEEE Transactions on Pattern Analysis and Machine Intelligence
    • 1982
    • 283
    Estimation, inference, and specification analysis
    • 714
    A Method for Discriminating between Models
    • 252
    Linear Statistical Inference and Its Applications
    • 1,456
    The Advanced Theory of Statistics
    • 1,763
    Modeling By Shortest Data Description*
    • 5,978
    • PDF
    Problems and solutions in theoretical statistics
    • 34
    Fundamentals of statistical signal processing: estimation theory
    • 9,523
    • PDF