The Nested Dirichlet Process

  title={The Nested Dirichlet Process},
  author={Abel Rodr{\'i}guez and David B. Dunson and Alan E. Gelfand},
  journal={Journal of the American Statistical Association},
  pages={1131 - 1154}
In multicenter studies, subjects in different centers may have different outcome distributions. This article is motivated by the problem of nonparametric modeling of these distributions, borrowing information across centers while also allowing centers to be clustered. Starting with a stick-breaking representation of the Dirichlet process (DP), we replace the random atoms with random probability measures drawn from a DP. This results in a nested DP prior, which can be placed on the collection of… 

Spatial Normalized Gamma Processes

A simple and general framework to construct dependent DPs by marginalizing and normalizing a single gamma process over an extended space is proposed and an empirical study of convergence on a synthetic dataset is reported.

Posterior Distribution for the Number of Clusters in Dirichlet Process Mixture Models

This work provides a rigorous study for the posterior distribution of the number of clusters in DPMM under different prior distributions on the parameters and constraints on the distributions of the data.

The Semi-Hierarchical Dirichlet Process and Its Application to Clustering Homogeneous Distributions

Assessing homogeneity of distributions is an old problem that has received considerable attention, especially in the nonparametric Bayesian literature. To this effect, we propose the

Bayesian clustering of distributions in stochastic frontier analysis

In stochastic frontier analysis, firm-specific efficiencies and their distribution are often main variables of interest. If firms fall into several groups, it is natural to allow each group to have


An efficient Monte Carlo Markov Chain algorithm for posterior computation is provided and a new class of multivariate dependent Dirichlet processes (DDP) is introduced in terms of vector of stick-breaking processes with dependent weights.

Latent Nested Nonparametric Priors (with Discussion).

A novel class of latent nested processes is introduced by adding common and group-specific completely random measures and normalizing to yield dependent random probability measures, and a Markov Chain Monte Carlo sampler for Bayesian inferences is developed.

Functional clustering in nested designs: Modeling variability in reproductive epidemiology studies

A mixture model based on a generalization of the nested Dirichlet process that clusters subjects based on the distribution of their curves induces a much more flexible prior on the partition structure than other popular model-based clustering methods.

Vectors of two-parameter Poisson-Dirichlet processes

Posterior simulation across nonparametric models for functional clustering

A novel Metropolis-Hastings algorithm for moving between models, with a nested generalized collapsed Gibbs sampler for updating the model parameters, and a Dirichlet process priors approach to the problem of clustering of hormone trajectories are applied.

The Dependent Dirichlet Process and Related Models

Standard regression approaches assume that some finite number of the response distribution characteristics, such as location and scale, change as a (parametric or nonparametric) function of



Order-Based Dependent Dirichlet Processes

This article allows the nonparametric distribution to depend on covariates through ordering the random variables building the weights in the stick-breaking representation and derives the correlation between distributions at different covariate values.

Modelling Heterogeneity With and Without the Dirichlet Process

We investigate the relationships between Dirichlet process (DP) based models and allocation models for a variable number of components, based on exchangeable distributions. It is shown that the DP

Approximate Dirichlet Process Computing in Finite Normal Mixtures

A rich nonparametric analysis of the finite normal mixture model is obtained by working with a precise truncation approximation of the Dirichlet process. Model fitting is carried out by a simple

Sampling the Dirichlet Mixture Model with Slices

  • S. Walker
  • Mathematics, Computer Science
    Commun. Stat. Simul. Comput.
  • 2007
The key to the algorithm detailed in this article, which also keeps the random distribution functions, is the introduction of a latent variable which allows a finite number of objects to be sampled within each iteration of a Gibbs sampler.

Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems

process. This paper extends Ferguson's result to cases where the random measure is a mixing distribution for a parameter which determines the distribution from which observations are made. The

Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models

This paper designs two novel Markov chain Monte Carlo algorithms which sample from the exact posterior distribution of quantities of interest and shows how the algorithms can obtain samples from functionals of the Dirichlet process.

Estimating mixture of dirichlet process models

A conceptual framework for computational strategies is proposed that provides a perspective on current methods, facilitates comparisons between them, and leads to several new methods that expand the scope of MDP models to nonconjugate situations.

A Split-Merge Markov chain Monte Carlo Procedure for the Dirichlet Process Mixture Model

A split-merge Markov chain algorithm is proposed to address the problem of inefficient sampling for conjugate Dirichlet process mixture models by employing a new technique in which an appropriate proposal for splitting or merging components is obtained by using a restricted Gibbs sampling scan.

Collapsed Variational Dirichlet Process Mixture Models

A number of variational Bayesian approximations to the Dirichlet process (DP) mixture model are studied and a novel collapsed VB approximation where mixture weights are marginalized out is considered.

Markov Chain Sampling Methods for Dirichlet Process Mixture Models

Abstract This article reviews Markov chain methods for sampling from the posterior distribution of a Dirichlet process mixture model and presents two new classes of methods. One new approach is to