Corpus ID: 155091694

Information criteria for non-normalized models

  title={Information criteria for non-normalized models},
  author={T. Matsuda and Masatoshi Uehara and A. Hyv{\"a}rinen},
  • T. Matsuda, Masatoshi Uehara, A. Hyvärinen
  • Published 2019
  • Mathematics, Computer Science
  • ArXiv
  • Many statistical models are given in the form of non-normalized densities with an intractable normalization constant. Since maximum likelihood estimation is computationally intensive for these models, several estimation methods have been developed which do not require explicit computation of the normalization constant, such as noise contrastive estimation (NCE) and score matching. However, model selection methods for general non-normalized models have not been proposed so far. In this study, we… CONTINUE READING

    Figures, Tables, and Topics from this paper.

    Explore Further: Topics Discussed in This Paper


    Estimation of Non-Normalized Statistical Models by Score Matching
    • A. Hyvärinen
    • Computer Science, Mathematics
    • J. Mach. Learn. Res.
    • 2005
    • 379
    • PDF
    Estimation of Non-Normalized Mixture Models
    • 5
    • PDF
    Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
    • 636
    • PDF
    Noise-Contrastive Estimation of Unnormalized Statistical Models, with Applications to Natural Image Statistics
    • 443
    • PDF
    Some extensions of score matching
    • A. Hyvärinen
    • Computer Science, Mathematics
    • Comput. Stat. Data Anal.
    • 2007
    • 163
    • PDF
    Analysis of Noise Contrastive Estimation from the Perspective of Asymptotic Variance
    • 8
    • PDF
    Bayesian Model Comparison with the Hyvärinen Score: Computation and Consistency
    • 17
    • PDF
    Graphical Models for Non-Negative Data Using Generalized Score Matching
    • 10
    • PDF
    Imputation estimators for unnormalized models with missing data
    • 3
    • PDF
    Information criteria for the predictive evaluation of bayesian models
    • 22