# Posterior convergence rates in non-linear latent variable models

@article{Pati2011PosteriorCR, title={Posterior convergence rates in non-linear latent variable models}, author={Debdeep Pati and Anirban Bhattacharya and David B. Dunson}, journal={arXiv: Statistics Theory}, year={2011} }

Non-linear latent variable models have become increasingly popular in a variety of applications. However, there has been little study on theoretical properties of these models. In this article, we study rates of posterior contraction in univariate density estimation for a class of non-linear latent variable models where unobserved U(0,1) latent variables are related to the response variables via a random non-linear regression with an additive error. Our approach relies on characterizing the…

## 6 Citations

### Latent factor density regression models

- Computer Science
- 2012

The proposed approach is based on a novel extension of the recently proposed latent variable density estimation model in which the response variables conditioned on the predictors are modeled as unknown functions of uniformly distributed latent variables and theredictors with an additive Gaussian error.

### Bayesian nonparametric modeling and theory for complex data

- Mathematics
- 2012

The dissertation focuses on solving some important theoretical and methodological problems associated with Bayesian modeling of infinite dimensional ‘objects’, popularly called nonparametric Bayes.…

### Rates of convergence for nonparametric estimation of singular distributions using generative adversarial networks

- Computer Science
- 2022

The convergence rate of a GAN type estimator with respect to the Wasserstein metric is found to be faster than that obtained by likelihood approaches, which provides insights into why GAN approaches perform better in many real problems.

### Some Recent Advances in Non- and Semiparametric Bayesian Modeling with Copulas, Mixtures, and Latent Variables

- Computer Science
- 2013

Some Recent Advances in Nonand Semiparametric Bayesian Modeling with Copulas, Mixtures, and Latent Variables by Jared S. Murray Department of Statistical Science Duke University

### Density Regression with Bayesian Additive Regression Trees

- Computer Science
- 2021

This work considers a continuous latent variable model in general covariate spaces, which it calls DR-BART, and proves that the posterior induced by the model concentrates quickly around true generative functions that are sufficiently smooth.

### Bayesian Factor Analysis for Inference on Interactions

- Computer ScienceJournal of the American Statistical Association
- 2021

A latent factor joint model is proposed, which includes shared factors in both the predictor and response components while assuming conditional independence, and a Bayesian approach to inference is proposed under this Factor analysis for INteractions (FIN) framework.

## References

SHOWING 1-10 OF 32 REFERENCES

### Single Factor Transformation Priors for Density Regression

- Computer Science
- 2011

A flexible class of priors based on random nonlinear functions of a uniform latent variable with an additive residual is proposed, related to Gaussian process latent variable models proposed in the machine learning literature.

### Rates of contraction of posterior distributions based on Gaussian process priors

- Mathematics, Computer Science
- 2008

The rate of contraction of the posterior distribution based on sampling from a smooth density model when the prior models the log density as a (fractionally integrated) Brownian motion is shown to depend on the position of the true parameter relative to the reproducing kernel Hilbert space of the Gaussian process.

### Posterior convergence rates of Dirichlet mixtures at smooth densities

- Mathematics
- 2007

We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twice…

### Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models

- Computer ScienceJ. Mach. Learn. Res.
- 2005

A novel probabilistic interpretation of principal component analysis (PCA) that is based on a Gaussian process latent variable model (GP-LVM), and related to popular spectral techniques such as kernel PCA and multidimensional scaling.

### Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data

- Computer ScienceNIPS
- 2003

A new underlying probabilistic model for principal component analysis (PCA) is introduced that shows that if the prior's covariance function constrains the mappings to be linear the model is equivalent to PCA, and is extended by considering less restrictive covariance functions which allow non-linear mappings.

### The Logistic Normal Distribution for Bayesian, Nonparametric, Predictive Densities

- Mathematics
- 1988

Abstract This article models the common density of an exchangeable sequence of observations by a generalization of the process derived from a logistic transform of a Gaussian process. The support of…

### Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities

- Mathematics
- 2001

We study the rates of convergence of the maximum likelihood estimator (MLE) and posterior distribution in density estimation problems, where the densities are location or location-scale mixtures of…

### Towards a Faster Implementation of Density Estimation With Logistic Gaussian Process Priors

- Computer Science
- 2007

It is established that imputation results in quite accurate computation of the Bayes estimate for a logistic Gaussian process prior for density estimation, and simulation studies show that accuracy and high speed can be combined.

### Adaptive Bayesian density estimation with location-scale mixtures

- Mathematics, Computer Science
- 2010

Convergence rates of Bayesian density estimators based on finite location-scale mixtures of exponential power distributions are studied to derive posterior concentration rates, with priors based on these mixture models.

### EXACT MEAN INTEGRATED SQUARED ERROR

- Mathematics
- 1992

An exact and easily computable expression for the mean integrated squared error (MISE) for the kernel estimator of a general normal mixture density, is given for Gaussian kernels of arbitrary order.…